Skip to content

Reduce vortex-fastlanes debug symbols by halving unchecked_unpack_cmp monomorphization - #8504

Draft
AdamGS wants to merge 3 commits into
developfrom
adamg/cmp-experiment
Draft

Reduce vortex-fastlanes debug symbols by halving unchecked_unpack_cmp monomorphization#8504
AdamGS wants to merge 3 commits into
developfrom
adamg/cmp-experiment

Conversation

@AdamGS

@AdamGS AdamGS commented Jun 19, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

Summary

vortex-fastlanes is currently a pretty big crate, due to its underlying structure/generics.

When running cargo clean; cargo build -p vortex-fastlanes

Currently on `develop:

  • vortex-fastlanes dev build with debug: 229MB rlib 105s
  • vortex-fastlanes dev build no debug: 119MB rlib 57s

We currently disable debug symbols for it to improve our development experience, but underlying crates can't enjoy that without explicitly adding the same or similar configuration.

With this branch, the build takes 50s and generates a 133MB rlib, with no performance impact for release builds.
For a release build, this change saves about 2.5MB (out of 7.4MB).

@codspeed-hq

codspeed-hq Bot commented Jun 19, 2026 •
edited
Loading

Copy link
Copy Markdown

Merging this PR will not alter performance

✅ 1660 untouched benchmarks
⏩ 47 skipped benchmarks1

Comparing adamg/cmp-experiment (ff7d356) with develop (5abaf98)

Open in CodSpeed

Footnotes

  1. 47 benchmarks were skipped, so the baseline results were used instead. If they were deleted from the codebase, click here and archive them to remove them from the performance reports. ↩

@AdamGS AdamGS changed the title Adamg/cmp experiment Reduce vortex-fastlanes debug symbols by halving unchecked_unpack_cmp monomorphization Jun 19, 2026
@AdamGS AdamGS added the changelog/performance A performance improvement label Jun 19, 2026
AdamGS added 3 commits June 19, 2026 13:16
@AdamGS
Reduce vortex-fastlanes debug symbolx size without config
f3b7ac6 
Signed-off-by: Adam Gutglick <adam@spiraldb.com>
@AdamGS
.
d833f46 
Signed-off-by: Adam Gutglick <adam@spiraldb.com>
@AdamGS
fastlanes experiment
ff7d356 
Signed-off-by: Adam Gutglick <adam@spiraldb.com>
@AdamGS
AdamGS force-pushed the adamg/cmp-experiment branch from c31e5d9 to ff7d356 Compare June 19, 2026 12:16
@AdamGS
AdamGS requested a review from joseph-isaacs June 19, 2026 12:20
robert3005
robert3005 reviewed Jun 19, 2026
View reviewed changes
Comment thread encodings/fastlanes/src/bitpacking/compute/compare_fused.rs
@AdamGS
AdamGS force-pushed the adamg/cmp-experiment branch from cb2d2fd to ff7d356 Compare June 19, 2026 13:52
@github-actions

github-actions Bot commented Jul 5, 2026

Copy link
Copy Markdown
Contributor

This PR has been marked as stale because it has been open for 14 days with no activity. Please comment or remove the stale label if you wish to keep it active, otherwise it will be closed in 7 days

@github-actions github-actions Bot added the stale This PR is stale and will be auto-closed soon label Jul 5, 2026
@github-actions

github-actions Bot commented Jul 13, 2026

Copy link
Copy Markdown
Contributor

This PR was closed because it has been inactive for 7 days since being marked as stale.

@github-actions github-actions Bot closed this Jul 13, 2026
@joseph-isaacs

joseph-isaacs commented Jul 13, 2026

Copy link
Copy Markdown
Contributor

We should offer this as an option or the default.

It halves code size. For the cost of a 16 word negation

@joseph-isaacs joseph-isaacs reopened this Jul 14, 2026
@joseph-isaacs joseph-isaacs added action/benchmark Trigger full benchmarks to run on this PR and removed stale This PR is stale and will be auto-closed soon labels Jul 14, 2026
@github-actions github-actions Bot removed the action/benchmark Trigger full benchmarks to run on this PR label Jul 14, 2026
@github-actions

github-actions Bot commented Jul 14, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done ff7d356 1 Explore Profiling Data

Powered by Polar Signals Cloud

@github-actions

github-actions Bot commented Jul 14, 2026

Copy link
Copy Markdown
Contributor

🚨🚨🚨❌❌❌ SQL BENCHMARK FAILED ❌❌❌🚨🚨🚨

Benchmark Clickbench Sorted on NVME (full) failed! Check the workflow run for details.

@github-actions

github-actions Bot commented Jul 14, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: PolarSignals Profiling

Vortex (geomean): 1.050x ➖

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (1.050x ➖, 0↑ 3↓)
name PR ff7d356 (ns) base 5abaf98 (ns) ratio (PR/base)
polarsignals_q00/datafusion:vortex-file-compressed 113443613 119332370 0.95
polarsignals_q01/datafusion:vortex-file-compressed 275545796 272448458 1.01
polarsignals_q02/datafusion:vortex-file-compressed 24374588 25678472 0.95
polarsignals_q03/datafusion:vortex-file-compressed 287199587 268375029 1.07
polarsignals_q04/datafusion:vortex-file-compressed 10274007 9537068 1.08
polarsignals_q05/datafusion:vortex-file-compressed 🚨 16775335 14686535 1.14
polarsignals_q06/datafusion:vortex-file-compressed 🚨 22716518 20555113 1.11
polarsignals_q07/datafusion:vortex-file-compressed 14456757 13517690 1.07
polarsignals_q08/datafusion:vortex-file-compressed 409864641 394962134 1.04
polarsignals_q09/datafusion:vortex-file-compressed 🚨 12431716 11294766 1.10
File Size Changes (1 files changed, -0.0% overall, 0↑ 1↓)
File Scale Format Base HEAD Change %
stacktraces.vortex 1000000 vortex-file-compressed 685.83 MB 685.83 MB 1.54 KB -0.0%

Totals:

  • vortex-file-compressed: 685.83 MB → 685.83 MB (-0.0%)

@github-actions

github-actions Bot commented Jul 14, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb NVMe

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +1.3%
Engines: DataFusion No clear signal (-0.2%, low confidence) · DuckDB No clear signal (+2.9%, low confidence)
Vortex (geomean): 0.995x ➖
Parquet (geomean): 0.982x ➖
Shifts: Parquet (control) -1.8% · Median polish -2.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (0.971x ➖, 1↑ 0↓)
name PR ff7d356 (ns) base 5abaf98 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 5538136 5314215 1.04
fineweb_q01/datafusion:vortex-file-compressed 🚀 33048850 37792414 0.87
fineweb_q02/datafusion:vortex-file-compressed 41539449 39724849 1.05
fineweb_q03/datafusion:vortex-file-compressed 65901971 67824143 0.97
fineweb_q04/datafusion:vortex-file-compressed 287208909 292259451 0.98
fineweb_q05/datafusion:vortex-file-compressed 225519365 237246123 0.95
fineweb_q06/datafusion:vortex-file-compressed 52515034 54102665 0.97
fineweb_q07/datafusion:vortex-file-compressed 58755349 59171391 0.99
fineweb_q08/datafusion:vortex-file-compressed 23386537 25300279 0.92
datafusion / vortex-compact (0.982x ➖, 1↑ 0↓)
name PR ff7d356 (ns) base 5abaf98 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 5764726 5860117 0.98
fineweb_q01/datafusion:vortex-compact 🚀 97255588 108463753 0.90
fineweb_q02/datafusion:vortex-compact 109943717 114172813 0.96
fineweb_q03/datafusion:vortex-compact 896302446 898631808 1.00
fineweb_q04/datafusion:vortex-compact 957857137 966323316 0.99
fineweb_q05/datafusion:vortex-compact 836717953 860107783 0.97
fineweb_q06/datafusion:vortex-compact 478703333 477411517 1.00
fineweb_q07/datafusion:vortex-compact 506001482 498704611 1.01
fineweb_q08/datafusion:vortex-compact 22353832 21971792 1.02
datafusion / parquet (0.979x ➖, 0↑ 0↓)
name PR ff7d356 (ns) base 5abaf98 (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 7138503 6971665 1.02
fineweb_q01/datafusion:parquet 301520063 308094395 0.98
fineweb_q02/datafusion:parquet 307329686 309542000 0.99
fineweb_q03/datafusion:parquet 315546617 302241476 1.04
fineweb_q04/datafusion:parquet 317454989 328727278 0.97
fineweb_q05/datafusion:parquet 306239239 334174416 0.92
fineweb_q06/datafusion:parquet 301452564 315434091 0.96
fineweb_q07/datafusion:parquet 292365450 304977459 0.96
fineweb_q08/datafusion:parquet 288348076 294555830 0.98
duckdb / vortex-file-compressed (0.999x ➖, 0↑ 1↓)
name PR ff7d356 (ns) base 5abaf98 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 🚨 3788599 3272959 1.16
fineweb_q01/duckdb:vortex-file-compressed 35315434 34869703 1.01
fineweb_q02/duckdb:vortex-file-compressed 41066233 41975917 0.98
fineweb_q03/duckdb:vortex-file-compressed 118955341 127477391 0.93
fineweb_q04/duckdb:vortex-file-compressed 279426689 289503301 0.97
fineweb_q05/duckdb:vortex-file-compressed 224861243 236061094 0.95
fineweb_q06/duckdb:vortex-file-compressed 54136923 55210948 0.98
fineweb_q07/duckdb:vortex-file-compressed 56796215 58530650 0.97
fineweb_q08/duckdb:vortex-file-compressed 24622861 23205446 1.06
duckdb / vortex-compact (1.028x ➖, 0↑ 1↓)
name PR ff7d356 (ns) base 5abaf98 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 🚨 4515909 3506509 1.29
fineweb_q01/duckdb:vortex-compact 116344117 108681698 1.07
fineweb_q02/duckdb:vortex-compact 117970568 112723556 1.05
fineweb_q03/duckdb:vortex-compact 869503782 909145569 0.96
fineweb_q04/duckdb:vortex-compact 923969002 958722048 0.96
fineweb_q05/duckdb:vortex-compact 825691295 857108760 0.96
fineweb_q06/duckdb:vortex-compact 467719946 493352664 0.95
fineweb_q07/duckdb:vortex-compact 490352499 500417441 0.98
fineweb_q08/duckdb:vortex-compact 21364046 19881429 1.07
duckdb / parquet (0.985x ➖, 0↑ 0↓)
name PR ff7d356 (ns) base 5abaf98 (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 33760269 33708230 1.00
fineweb_q01/duckdb:parquet 88917497 92015811 0.97
fineweb_q02/duckdb:parquet 90587404 92140479 0.98
fineweb_q03/duckdb:parquet 329921912 336827347 0.98
fineweb_q04/duckdb:parquet 459597980 460528613 1.00
fineweb_q05/duckdb:parquet 424209246 432565062 0.98
fineweb_q06/duckdb:parquet 210745293 215541796 0.98
fineweb_q07/duckdb:parquet 224031187 228317889 0.98
fineweb_q08/duckdb:parquet 37058609 37284530 0.99
File Size Changes (2 files changed, +0.0% overall, 1↑ 1↓)
File Scale Format Base HEAD Change %
sample.vortex 1.0 vortex-file-compressed 1.43 GB 1.43 GB +565.34 KB +0.0%
sample.vortex 1.0 vortex-compact 1.23 GB 1.23 GB 160 B -0.0%

Totals:

  • vortex-compact: 1.23 GB → 1.23 GB (-0.0%)
  • vortex-file-compressed: 1.43 GB → 1.43 GB (+0.0%)

@github-actions

github-actions Bot commented Jul 14, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -1.1%
Engines: DataFusion No clear signal (-1.9%, low confidence) · DuckDB No clear signal (-0.3%, environment too noisy confidence)
Vortex (geomean): 1.043x ➖
Parquet (geomean): 1.039x ➖
Shifts: Parquet (control) +3.9% · Median polish +3.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (1.091x ➖, 0↑ 3↓)
name PR ff7d356 (ns) base 5abaf98 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 50517148 51465339 0.98
tpch_q02/datafusion:vortex-file-compressed 23851660 22493905 1.06
tpch_q03/datafusion:vortex-file-compressed 32987095 30233012 1.09
tpch_q04/datafusion:vortex-file-compressed 20060036 19435692 1.03
tpch_q05/datafusion:vortex-file-compressed 50148238 47062005 1.07
tpch_q06/datafusion:vortex-file-compressed 10154591 9243398 1.10
tpch_q07/datafusion:vortex-file-compressed 54287012 51765649 1.05
tpch_q08/datafusion:vortex-file-compressed 41459849 38551412 1.08
tpch_q09/datafusion:vortex-file-compressed 🚨 55115541 50091374 1.10
tpch_q10/datafusion:vortex-file-compressed 34328214 32034972 1.07
tpch_q11/datafusion:vortex-file-compressed 17236693 16026600 1.08
tpch_q12/datafusion:vortex-file-compressed 24558304 23150732 1.06
tpch_q13/datafusion:vortex-file-compressed 27396788 26343907 1.04
tpch_q14/datafusion:vortex-file-compressed 15617938 14709629 1.06
tpch_q15/datafusion:vortex-file-compressed 23535062 22620556 1.04
tpch_q16/datafusion:vortex-file-compressed 20967606 19461106 1.08
tpch_q17/datafusion:vortex-file-compressed 70954437 65184819 1.09
tpch_q18/datafusion:vortex-file-compressed 78870348 75387306 1.05
tpch_q19/datafusion:vortex-file-compressed 🚨 34425793 18272328 1.88
tpch_q20/datafusion:vortex-file-compressed 31181046 29669381 1.05
tpch_q21/datafusion:vortex-file-compressed 🚨 75802360 68426896 1.11
tpch_q22/datafusion:vortex-file-compressed 12460751 11833045 1.05
datafusion / vortex-compact (0.978x ➖, 5↑ 1↓)
name PR ff7d356 (ns) base 5abaf98 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 62214430 58934532 1.06
tpch_q02/datafusion:vortex-compact 27603483 25678810 1.07
tpch_q03/datafusion:vortex-compact 33677016 34064970 0.99
tpch_q04/datafusion:vortex-compact 22879871 22936295 1.00
tpch_q05/datafusion:vortex-compact 52330267 48943428 1.07
tpch_q06/datafusion:vortex-compact 12876223 12861944 1.00
tpch_q07/datafusion:vortex-compact 59275170 55061085 1.08
tpch_q08/datafusion:vortex-compact 43782980 42325091 1.03
tpch_q09/datafusion:vortex-compact 57718617 56752973 1.02
tpch_q10/datafusion:vortex-compact 37346089 41360459 0.90
tpch_q11/datafusion:vortex-compact 18213558 19718764 0.92
tpch_q12/datafusion:vortex-compact 31020898 34428198 0.90
tpch_q13/datafusion:vortex-compact 🚀 32801622 36460789 0.90
tpch_q14/datafusion:vortex-compact 🚀 18652184 20781419 0.90
tpch_q15/datafusion:vortex-compact 32202858 33311522 0.97
tpch_q16/datafusion:vortex-compact 26230521 25307283 1.04
tpch_q17/datafusion:vortex-compact 🚀 72136252 81267566 0.89
tpch_q18/datafusion:vortex-compact 🚀 80588829 94086064 0.86
tpch_q19/datafusion:vortex-compact 🚨 55223546 43447213 1.27
tpch_q20/datafusion:vortex-compact 37048166 39730769 0.93
tpch_q21/datafusion:vortex-compact 🚀 79675271 94156120 0.85
tpch_q22/datafusion:vortex-compact 14353629 14812716 0.97
datafusion / parquet (1.035x ➖, 0↑ 1↓)
name PR ff7d356 (ns) base 5abaf98 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 137981451 135262260 1.02
tpch_q02/datafusion:parquet 64800543 61002187 1.06
tpch_q03/datafusion:parquet 85831646 82584991 1.04
tpch_q04/datafusion:parquet 47555704 47631107 1.00
tpch_q05/datafusion:parquet 96927398 92583041 1.05
tpch_q06/datafusion:parquet 44516227 42214316 1.05
tpch_q07/datafusion:parquet 108754820 110095492 0.99
tpch_q08/datafusion:parquet 93865605 97339479 0.96
tpch_q09/datafusion:parquet 125154757 127099430 0.98
tpch_q10/datafusion:parquet 119233609 114548433 1.04
tpch_q11/datafusion:parquet 43729326 41185401 1.06
tpch_q12/datafusion:parquet 77127569 80563942 0.96
tpch_q13/datafusion:parquet 207393474 191076701 1.09
tpch_q14/datafusion:parquet 46300211 44602097 1.04
tpch_q15/datafusion:parquet 61887595 60045963 1.03
tpch_q16/datafusion:parquet 46243378 42387196 1.09
tpch_q17/datafusion:parquet 🚨 149713858 135009594 1.11
tpch_q18/datafusion:parquet 163851818 154154104 1.06
tpch_q19/datafusion:parquet 77395974 74889100 1.03
tpch_q20/datafusion:parquet 74683528 72952460 1.02
tpch_q21/datafusion:parquet 148067992 143105250 1.03
tpch_q22/datafusion:parquet 46481523 44035897 1.06
datafusion / arrow (0.980x ➖, 3↑ 0↓)
name PR ff7d356 (ns) base 5abaf98 (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 60576248 62714993 0.97
tpch_q02/datafusion:arrow 17659946 17388903 1.02
tpch_q03/datafusion:arrow 34011940 33187161 1.02
tpch_q04/datafusion:arrow 28184025 26871860 1.05
tpch_q05/datafusion:arrow 61424519 56511158 1.09
tpch_q06/datafusion:arrow 23238189 21370143 1.09
tpch_q07/datafusion:arrow 111614116 111847621 1.00
tpch_q08/datafusion:arrow 47329348 50638192 0.93
tpch_q09/datafusion:arrow 🚀 68180858 78091380 0.87
tpch_q10/datafusion:arrow 🚀 51791279 61836510 0.84
tpch_q11/datafusion:arrow 9439340 10110089 0.93
tpch_q12/datafusion:arrow 54539367 56006132 0.97
tpch_q13/datafusion:arrow 45839886 49336204 0.93
tpch_q14/datafusion:arrow 24791603 27349775 0.91
tpch_q15/datafusion:arrow 🚀 47828547 54686296 0.87
tpch_q16/datafusion:arrow 17091058 18283916 0.93
tpch_q17/datafusion:arrow 72501108 74726006 0.97
tpch_q18/datafusion:arrow 114771195 110112454 1.04
tpch_q19/datafusion:arrow 39223787 37609038 1.04
tpch_q20/datafusion:arrow 38270977 36572453 1.05
tpch_q21/datafusion:arrow 165933410 161193577 1.03
tpch_q22/datafusion:arrow 12977617 12235793 1.06
duckdb / vortex-file-compressed (1.051x ➖, 0↑ 4↓)
name PR ff7d356 (ns) base 5abaf98 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 31835665 29009748 1.10
tpch_q02/duckdb:vortex-file-compressed 26715261 26708580 1.00
tpch_q03/duckdb:vortex-file-compressed 33522980 35390125 0.95
tpch_q04/duckdb:vortex-file-compressed 30096427 29678358 1.01
tpch_q05/duckdb:vortex-file-compressed 38966712 38904097 1.00
tpch_q06/duckdb:vortex-file-compressed 8383806 9087211 0.92
tpch_q07/duckdb:vortex-file-compressed 37993266 36598796 1.04
tpch_q08/duckdb:vortex-file-compressed 42658647 42887635 0.99
tpch_q09/duckdb:vortex-file-compressed 62239077 61753806 1.01
tpch_q10/duckdb:vortex-file-compressed 43635875 41607873 1.05
tpch_q11/duckdb:vortex-file-compressed 15073017 14356561 1.05
tpch_q12/duckdb:vortex-file-compressed 23776166 22901185 1.04
tpch_q13/duckdb:vortex-file-compressed 42297904 40567740 1.04
tpch_q14/duckdb:vortex-file-compressed 🚨 22720525 19796367 1.15
tpch_q15/duckdb:vortex-file-compressed 17388774 16035038 1.08
tpch_q16/duckdb:vortex-file-compressed 29845684 27438460 1.09
tpch_q17/duckdb:vortex-file-compressed 24949561 23613105 1.06
tpch_q18/duckdb:vortex-file-compressed 🚨 58005585 52184958 1.11
tpch_q19/duckdb:vortex-file-compressed 🚨 30724054 25278374 1.22
tpch_q20/duckdb:vortex-file-compressed 🚨 34557649 31328386 1.10
tpch_q21/duckdb:vortex-file-compressed 105482133 98396463 1.07
tpch_q22/duckdb:vortex-file-compressed 17995043 16491126 1.09
duckdb / vortex-compact (1.054x ➖, 1↑ 7↓)
name PR ff7d356 (ns) base 5abaf98 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 39236319 38890454 1.01
tpch_q02/duckdb:vortex-compact 🚨 34405306 30394214 1.13
tpch_q03/duckdb:vortex-compact 35220849 34837721 1.01
tpch_q04/duckdb:vortex-compact 31718777 33479436 0.95
tpch_q05/duckdb:vortex-compact 42826026 40209746 1.07
tpch_q06/duckdb:vortex-compact 10256034 10677944 0.96
tpch_q07/duckdb:vortex-compact 42934468 41363320 1.04
tpch_q08/duckdb:vortex-compact 48037632 45332418 1.06
tpch_q09/duckdb:vortex-compact 68710386 66309291 1.04
tpch_q10/duckdb:vortex-compact 48195517 45998095 1.05
tpch_q11/duckdb:vortex-compact 🚨 19378748 15793729 1.23
tpch_q12/duckdb:vortex-compact 31793884 31765059 1.00
tpch_q13/duckdb:vortex-compact 47864859 46051379 1.04
tpch_q14/duckdb:vortex-compact 🚨 27006081 23049020 1.17
tpch_q15/duckdb:vortex-compact 20515091 19903701 1.03
tpch_q16/duckdb:vortex-compact 🚨 33417697 28894412 1.16
tpch_q17/duckdb:vortex-compact 🚨 30131860 27276832 1.10
tpch_q18/duckdb:vortex-compact 57148104 58309153 0.98
tpch_q19/duckdb:vortex-compact 🚨 34559152 29113698 1.19
tpch_q20/duckdb:vortex-compact 🚨 41632445 36774914 1.13
tpch_q21/duckdb:vortex-compact 🚀 109337486 123525899 0.89
tpch_q22/duckdb:vortex-compact 19414255 18888654 1.03
duckdb / parquet (1.044x ➖, 0↑ 2↓)
name PR ff7d356 (ns) base 5abaf98 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 77590616 80346845 0.97
tpch_q02/duckdb:parquet 40954526 39543451 1.04
tpch_q03/duckdb:parquet 72380439 70364690 1.03
tpch_q04/duckdb:parquet 54659067 49775214 1.10
tpch_q05/duckdb:parquet 69353775 67794267 1.02
tpch_q06/duckdb:parquet 23125018 22541700 1.03
tpch_q07/duckdb:parquet 🚨 85902303 69541465 1.24
tpch_q08/duckdb:parquet 84073463 84831252 0.99
tpch_q09/duckdb:parquet 139975412 133850689 1.05
tpch_q10/duckdb:parquet 129953305 126733655 1.03
tpch_q11/duckdb:parquet 23441072 22414285 1.05
tpch_q12/duckdb:parquet 50847195 51554036 0.99
tpch_q13/duckdb:parquet 266363727 249966154 1.07
tpch_q14/duckdb:parquet 52368616 51378901 1.02
tpch_q15/duckdb:parquet 🚨 32065048 26021798 1.23
tpch_q16/duckdb:parquet 59825527 57394957 1.04
tpch_q17/duckdb:parquet 55026968 56320421 0.98
tpch_q18/duckdb:parquet 120913537 119427542 1.01
tpch_q19/duckdb:parquet 79228876 72255196 1.10
tpch_q20/duckdb:parquet 66781281 65349646 1.02
tpch_q21/duckdb:parquet 188632731 181529564 1.04
tpch_q22/duckdb:parquet 54981045 55466257 0.99
duckdb / duckdb (1.017x ➖, 0↑ 0↓)
name PR ff7d356 (ns) base 5abaf98 (ns) ratio (PR/base)
tpch_q01/duckdb:duckdb 18424961 18763451 0.98
tpch_q02/duckdb:duckdb 15046606 15586593 0.97
tpch_q03/duckdb:duckdb 23364540 23555077 0.99
tpch_q04/duckdb:duckdb 23016742 22816499 1.01
tpch_q05/duckdb:duckdb 24280223 23730175 1.02
tpch_q06/duckdb:duckdb 7271891 7057451 1.03
tpch_q07/duckdb:duckdb 26629667 25753783 1.03
tpch_q08/duckdb:duckdb 25361064 24110149 1.05
tpch_q09/duckdb:duckdb 60621292 58463437 1.04
tpch_q10/duckdb:duckdb 52733940 52512367 1.00
tpch_q11/duckdb:duckdb 7633431 7521727 1.01
tpch_q12/duckdb:duckdb 18199516 18198405 1.00
tpch_q13/duckdb:duckdb 40816471 39999276 1.02
tpch_q14/duckdb:duckdb 22501057 21791705 1.03
tpch_q15/duckdb:duckdb 14025383 14011079 1.00
tpch_q16/duckdb:duckdb 27394736 26369242 1.04
tpch_q17/duckdb:duckdb 16783434 16477783 1.02
tpch_q18/duckdb:duckdb 41801978 40588471 1.03
tpch_q19/duckdb:duckdb 32729027 32157719 1.02
tpch_q20/duckdb:duckdb 25801933 25973810 0.99
tpch_q21/duckdb:duckdb 65120509 61459409 1.06
tpch_q22/duckdb:duckdb 26354072 25824969 1.02
File Size Changes (18 files changed, -0.0% overall, 11↑ 7↓)
File Scale Format Base HEAD Change %
nation_0.vortex 1.0 vortex-compact 7.80 KB 8.38 KB +588 B +7.4%
nation_0.vortex 1.0 vortex-file-compressed 10.84 KB 11.03 KB +196 B +1.8%
region_0.vortex 1.0 vortex-compact 5.83 KB 5.89 KB +60 B +1.0%
orders_0.vortex 1.0 vortex-file-compressed 35.04 MB 35.37 MB +334.63 KB +0.9%
supplier_0.vortex 1.0 vortex-compact 496.46 KB 496.75 KB +300 B +0.1%
partsupp_0.vortex 1.0 vortex-file-compressed 23.69 MB 23.69 MB +8.47 KB +0.0%
lineitem_0.vortex 1.0 vortex-file-compressed 82.13 MB 82.15 MB +13.87 KB +0.0%
lineitem_0.vortex 1.0 vortex-compact 63.00 MB 63.00 MB +1.97 KB +0.0%
lineitem_1.vortex 1.0 vortex-compact 63.03 MB 63.03 MB +1.96 KB +0.0%
customer_0.vortex 1.0 vortex-compact 7.43 MB 7.43 MB +212 B +0.0%
orders_0.vortex 1.0 vortex-compact 31.73 MB 31.73 MB +636 B +0.0%
customer_0.vortex 1.0 vortex-file-compressed 8.90 MB 8.89 MB 14.68 KB -0.2%
lineitem_1.vortex 1.0 vortex-file-compressed 82.11 MB 81.95 MB 167.93 KB -0.2%
partsupp_0.vortex 1.0 vortex-compact 21.04 MB 20.81 MB 229.75 KB -1.1%
part_0.vortex 1.0 vortex-file-compressed 4.98 MB 4.90 MB 75.36 KB -1.5%
supplier_0.vortex 1.0 vortex-file-compressed 616.35 KB 605.00 KB 11.35 KB -1.8%
part_0.vortex 1.0 vortex-compact 3.45 MB 3.38 MB 73.98 KB -2.1%
region_0.vortex 1.0 vortex-file-compressed 6.65 KB 6.19 KB 468 B -6.9%

Totals:

  • vortex-compact: 190.44 MB → 190.15 MB (-0.2%)
  • vortex-file-compressed: 237.73 MB → 237.82 MB (+0.0%)

@github-actions

github-actions Bot commented Jul 14, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-DS SF=1 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -3.4%
Engines: DataFusion No clear signal (-0.5%, low confidence) · DuckDB No clear signal (-5.5%, low confidence)
Vortex (geomean): 0.971x ➖
Parquet (geomean): 1.016x ➖
Shifts: Parquet (control) +1.6% · Median polish +1.8%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (1.029x ➖, 2↑ 13↓)
name PR ff7d356 (ns) base 5abaf98 (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-file-compressed 🚨 30617833 25132181 1.22
tpcds_q02/datafusion:vortex-file-compressed 50364919 48441913 1.04
tpcds_q03/datafusion:vortex-file-compressed 15511298 15662124 0.99
tpcds_q04/datafusion:vortex-file-compressed 🚨 275562661 240656515 1.15
tpcds_q05/datafusion:vortex-file-compressed 47419604 44678795 1.06
tpcds_q06/datafusion:vortex-file-compressed 25940050 24818813 1.05
tpcds_q07/datafusion:vortex-file-compressed 43096602 43026502 1.00
tpcds_q08/datafusion:vortex-file-compressed 32849579 31694135 1.04
tpcds_q09/datafusion:vortex-file-compressed 31609400 33183097 0.95
tpcds_q10/datafusion:vortex-file-compressed 42112079 40649902 1.04
tpcds_q11/datafusion:vortex-file-compressed 149014731 141105705 1.06
tpcds_q12/datafusion:vortex-file-compressed 19758990 18292676 1.08
tpcds_q13/datafusion:vortex-file-compressed 🚨 50384396 44545802 1.13
tpcds_q14/datafusion:vortex-file-compressed 172387816 166968398 1.03
tpcds_q15/datafusion:vortex-file-compressed 28460571 27840651 1.02
tpcds_q16/datafusion:vortex-file-compressed 🚨 27786935 24807457 1.12
tpcds_q17/datafusion:vortex-file-compressed 68577601 65175613 1.05
tpcds_q18/datafusion:vortex-file-compressed 68055512 63846208 1.07
tpcds_q19/datafusion:vortex-file-compressed 24319534 23812931 1.02
tpcds_q20/datafusion:vortex-file-compressed 🚨 22223938 20120517 1.10
tpcds_q21/datafusion:vortex-file-compressed 38530019 36986374 1.04
tpcds_q22/datafusion:vortex-file-compressed 132546812 127312448 1.04
tpcds_q23/datafusion:vortex-file-compressed 167101740 166576118 1.00
tpcds_q24/datafusion:vortex-file-compressed 93591018 94087126 0.99
tpcds_q25/datafusion:vortex-file-compressed 68700617 69232649 0.99
tpcds_q26/datafusion:vortex-file-compressed 🚨 37277867 33167616 1.12
tpcds_q27/datafusion:vortex-file-compressed 100876627 95099820 1.06
tpcds_q28/datafusion:vortex-file-compressed 33049493 34850631 0.95
tpcds_q29/datafusion:vortex-file-compressed 65275598 63127024 1.03
tpcds_q30/datafusion:vortex-file-compressed 27496733 25569872 1.08
tpcds_q31/datafusion:vortex-file-compressed 🚨 82298199 73589560 1.12
tpcds_q32/datafusion:vortex-file-compressed 19961473 19490585 1.02
tpcds_q33/datafusion:vortex-file-compressed 31985973 29804243 1.07
tpcds_q34/datafusion:vortex-file-compressed 🚨 29546731 26671668 1.11
tpcds_q35/datafusion:vortex-file-compressed 49046976 46603391 1.05
tpcds_q36/datafusion:vortex-file-compressed 61906911 59103007 1.05
tpcds_q37/datafusion:vortex-file-compressed 21978694 20610783 1.07
tpcds_q38/datafusion:vortex-file-compressed 45624160 42311235 1.08
tpcds_q39/datafusion:vortex-file-compressed 115855286 114654272 1.01
tpcds_q40/datafusion:vortex-file-compressed 33044189 30347454 1.09
tpcds_q41/datafusion:vortex-file-compressed 22346871 21087855 1.06
tpcds_q42/datafusion:vortex-file-compressed 15352833 14509906 1.06
tpcds_q43/datafusion:vortex-file-compressed 20109609 20507821 0.98
tpcds_q44/datafusion:vortex-file-compressed 31454888 31295652 1.01
tpcds_q45/datafusion:vortex-file-compressed 🚨 29654315 26287477 1.13
tpcds_q46/datafusion:vortex-file-compressed 39724727 38737152 1.03
tpcds_q47/datafusion:vortex-file-compressed 145199771 150692713 0.96
tpcds_q48/datafusion:vortex-file-compressed 37045559 38488357 0.96
tpcds_q49/datafusion:vortex-file-compressed 61527836 62690455 0.98
tpcds_q50/datafusion:vortex-file-compressed 44889560 43825218 1.02
tpcds_q51/datafusion:vortex-file-compressed 90972576 93413049 0.97
tpcds_q52/datafusion:vortex-file-compressed 14853178 15334395 0.97
tpcds_q53/datafusion:vortex-file-compressed 23442354 24034414 0.98
tpcds_q54/datafusion:vortex-file-compressed 35252525 37649220 0.94
tpcds_q55/datafusion:vortex-file-compressed 14801453 15311631 0.97
tpcds_q56/datafusion:vortex-file-compressed 31438476 32527735 0.97
tpcds_q57/datafusion:vortex-file-compressed 🚨 120922531 96859151 1.25
tpcds_q58/datafusion:vortex-file-compressed 60736566 58477951 1.04
tpcds_q59/datafusion:vortex-file-compressed 🚀 60802382 67866980 0.90
tpcds_q60/datafusion:vortex-file-compressed 31252922 32626635 0.96
tpcds_q61/datafusion:vortex-file-compressed 43730345 44793572 0.98
tpcds_q62/datafusion:vortex-file-compressed 🚨 26461720 23490775 1.13
tpcds_q63/datafusion:vortex-file-compressed 25064191 25372455 0.99
tpcds_q64/datafusion:vortex-file-compressed 400417473 436940258 0.92
tpcds_q65/datafusion:vortex-file-compressed 54659987 57346218 0.95
tpcds_q66/datafusion:vortex-file-compressed 74955780 77522126 0.97
tpcds_q67/datafusion:vortex-file-compressed 157011095 158420006 0.99
tpcds_q68/datafusion:vortex-file-compressed 35135627 34989159 1.00
tpcds_q69/datafusion:vortex-file-compressed 38416704 39797786 0.97
tpcds_q70/datafusion:vortex-file-compressed 102178551 98351629 1.04
tpcds_q71/datafusion:vortex-file-compressed 24877704 23451293 1.06
tpcds_q72/datafusion:vortex-file-compressed 2241079192 2283354156 0.98
tpcds_q73/datafusion:vortex-file-compressed 25445317 26642670 0.96
tpcds_q74/datafusion:vortex-file-compressed 88294360 85342415 1.03
tpcds_q75/datafusion:vortex-file-compressed 118558529 116787013 1.02
tpcds_q76/datafusion:vortex-file-compressed 29936850 29463558 1.02
tpcds_q77/datafusion:vortex-file-compressed 39968561 37988142 1.05
tpcds_q78/datafusion:vortex-file-compressed 123847934 117965366 1.05
tpcds_q79/datafusion:vortex-file-compressed 32443968 30752583 1.05
tpcds_q80/datafusion:vortex-file-compressed 96419319 91915745 1.05
tpcds_q81/datafusion:vortex-file-compressed 27336475 27542082 0.99
tpcds_q82/datafusion:vortex-file-compressed 🚀 23568450 26463093 0.89
tpcds_q83/datafusion:vortex-file-compressed 38200928 37120199 1.03
tpcds_q84/datafusion:vortex-file-compressed 13886783 13723557 1.01
tpcds_q85/datafusion:vortex-file-compressed 97057330 95471770 1.02
tpcds_q86/datafusion:vortex-file-compressed 🚨 18597616 16462637 1.13
tpcds_q87/datafusion:vortex-file-compressed 46304296 43611037 1.06
tpcds_q88/datafusion:vortex-file-compressed 58848155 58148130 1.01
tpcds_q89/datafusion:vortex-file-compressed 27820309 27448068 1.01
tpcds_q90/datafusion:vortex-file-compressed 14918421 14393948 1.04
tpcds_q91/datafusion:vortex-file-compressed 20066685 19159177 1.05
tpcds_q92/datafusion:vortex-file-compressed 17754931 17697389 1.00
tpcds_q93/datafusion:vortex-file-compressed 33880539 32232634 1.05
tpcds_q94/datafusion:vortex-file-compressed 22992243 22234786 1.03
tpcds_q95/datafusion:vortex-file-compressed 59995870 58203966 1.03
tpcds_q96/datafusion:vortex-file-compressed 13632575 13504470 1.01
tpcds_q97/datafusion:vortex-file-compressed 30754934 30918904 0.99
tpcds_q98/datafusion:vortex-file-compressed 25245275 25542160 0.99
tpcds_q99/datafusion:vortex-file-compressed 🚨 32323662 26629590 1.21
datafusion / vortex-compact (0.988x ➖, 17↑ 14↓)
name PR ff7d356 (ns) base 5abaf98 (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-compact 🚨 28369765 24303882 1.17
tpcds_q02/datafusion:vortex-compact 56279332 52189707 1.08
tpcds_q03/datafusion:vortex-compact 20486116 19627815 1.04
tpcds_q04/datafusion:vortex-compact 🚨 302120092 271145197 1.11
tpcds_q05/datafusion:vortex-compact 51142251 50534057 1.01
tpcds_q06/datafusion:vortex-compact 27750858 30352011 0.91
tpcds_q07/datafusion:vortex-compact 55564271 59665865 0.93
tpcds_q08/datafusion:vortex-compact 🚀 37722957 43240475 0.87
tpcds_q09/datafusion:vortex-compact 🚀 46373226 57790642 0.80
tpcds_q10/datafusion:vortex-compact 🚀 51109420 58435326 0.87
tpcds_q11/datafusion:vortex-compact 153669787 166760646 0.92
tpcds_q12/datafusion:vortex-compact 🚨 27335912 23299457 1.17
tpcds_q13/datafusion:vortex-compact 134396671 124824532 1.08
tpcds_q14/datafusion:vortex-compact 189074113 190078539 0.99
tpcds_q15/datafusion:vortex-compact 30095582 32155601 0.94
tpcds_q16/datafusion:vortex-compact 32375349 29926251 1.08
tpcds_q17/datafusion:vortex-compact 🚀 76282491 103381663 0.74
tpcds_q18/datafusion:vortex-compact 80329615 76102391 1.06
tpcds_q19/datafusion:vortex-compact 🚀 31257532 35841871 0.87
tpcds_q20/datafusion:vortex-compact 🚨 27620473 24969248 1.11
tpcds_q21/datafusion:vortex-compact 43386080 40719053 1.07
tpcds_q22/datafusion:vortex-compact 132934961 136461015 0.97
tpcds_q23/datafusion:vortex-compact 170919407 188943713 0.90
tpcds_q24/datafusion:vortex-compact 103356304 110080130 0.94
tpcds_q25/datafusion:vortex-compact 84494443 82694259 1.02
tpcds_q26/datafusion:vortex-compact 48764213 45150096 1.08
tpcds_q27/datafusion:vortex-compact 🚀 124275871 138296761 0.90
tpcds_q28/datafusion:vortex-compact 🚨 99619824 88776381 1.12
tpcds_q29/datafusion:vortex-compact 78403921 81007882 0.97
tpcds_q30/datafusion:vortex-compact 29905887 28703805 1.04
tpcds_q31/datafusion:vortex-compact 104401622 107143909 0.97
tpcds_q32/datafusion:vortex-compact 🚨 25975015 23520375 1.10
tpcds_q33/datafusion:vortex-compact 37740895 41824085 0.90
tpcds_q34/datafusion:vortex-compact 🚀 35715767 43885819 0.81
tpcds_q35/datafusion:vortex-compact 57377271 61808541 0.93
tpcds_q36/datafusion:vortex-compact 87105289 79899710 1.09
tpcds_q37/datafusion:vortex-compact 31917087 29496017 1.08
tpcds_q38/datafusion:vortex-compact 55148000 52590137 1.05
tpcds_q39/datafusion:vortex-compact 127150814 122516349 1.04
tpcds_q40/datafusion:vortex-compact 36865915 33761185 1.09
tpcds_q41/datafusion:vortex-compact 🚨 24988845 22707458 1.10
tpcds_q42/datafusion:vortex-compact 20101528 18833709 1.07
tpcds_q43/datafusion:vortex-compact 26412765 28628825 0.92
tpcds_q44/datafusion:vortex-compact 🚀 44130428 50655977 0.87
tpcds_q45/datafusion:vortex-compact 🚨 35649505 31556142 1.13
tpcds_q46/datafusion:vortex-compact 🚀 50044435 56821007 0.88
tpcds_q47/datafusion:vortex-compact 167625332 171616837 0.98
tpcds_q48/datafusion:vortex-compact 🚀 87593767 100279471 0.87
tpcds_q49/datafusion:vortex-compact 73644887 79196449 0.93
tpcds_q50/datafusion:vortex-compact 50840190 54422070 0.93
tpcds_q51/datafusion:vortex-compact 103274312 99892294 1.03
tpcds_q52/datafusion:vortex-compact 20881146 20102007 1.04
tpcds_q53/datafusion:vortex-compact 30678673 31212102 0.98
tpcds_q54/datafusion:vortex-compact 43407992 45782438 0.95
tpcds_q55/datafusion:vortex-compact 19357352 19301625 1.00
tpcds_q56/datafusion:vortex-compact 38685544 40762127 0.95
tpcds_q57/datafusion:vortex-compact 🚨 125094015 105939428 1.18
tpcds_q58/datafusion:vortex-compact 67486781 66788127 1.01
tpcds_q59/datafusion:vortex-compact 74766801 77249960 0.97
tpcds_q60/datafusion:vortex-compact 39883369 41688139 0.96
tpcds_q61/datafusion:vortex-compact 58540243 60885647 0.96
tpcds_q62/datafusion:vortex-compact 25874190 23537133 1.10
tpcds_q63/datafusion:vortex-compact 31491387 30809152 1.02
tpcds_q64/datafusion:vortex-compact 446286134 485544392 0.92
tpcds_q65/datafusion:vortex-compact 68899861 70304601 0.98
tpcds_q66/datafusion:vortex-compact 🚨 85738503 75992233 1.13
tpcds_q67/datafusion:vortex-compact 173494613 165395958 1.05
tpcds_q68/datafusion:vortex-compact 🚀 48846050 58011095 0.84
tpcds_q69/datafusion:vortex-compact 52612006 54738203 0.96
tpcds_q70/datafusion:vortex-compact 116748319 119595372 0.98
tpcds_q71/datafusion:vortex-compact 32420182 33857959 0.96
tpcds_q72/datafusion:vortex-compact 2391872223 2262018270 1.06
tpcds_q73/datafusion:vortex-compact 🚀 33111451 40735295 0.81
tpcds_q74/datafusion:vortex-compact 99372218 103301875 0.96
tpcds_q75/datafusion:vortex-compact 142096715 139102918 1.02
tpcds_q76/datafusion:vortex-compact 🚀 35400102 40513109 0.87
tpcds_q77/datafusion:vortex-compact 52102719 52271171 1.00
tpcds_q78/datafusion:vortex-compact 142199986 135267261 1.05
tpcds_q79/datafusion:vortex-compact 🚀 43328301 50882581 0.85
tpcds_q80/datafusion:vortex-compact 110477614 106466206 1.04
tpcds_q81/datafusion:vortex-compact 29914011 29453617 1.02
tpcds_q82/datafusion:vortex-compact 33121995 32327739 1.02
tpcds_q83/datafusion:vortex-compact 41820147 40043255 1.04
tpcds_q84/datafusion:vortex-compact 16628381 15951665 1.04
tpcds_q85/datafusion:vortex-compact 🚨 175632802 144489349 1.22
tpcds_q86/datafusion:vortex-compact 🚨 21288764 18359541 1.16
tpcds_q87/datafusion:vortex-compact 57552854 56181888 1.02
tpcds_q88/datafusion:vortex-compact 🚀 82643928 114116577 0.72
tpcds_q89/datafusion:vortex-compact 34391501 34623812 0.99
tpcds_q90/datafusion:vortex-compact 15438200 16387404 0.94
tpcds_q91/datafusion:vortex-compact 35445670 38439352 0.92
tpcds_q92/datafusion:vortex-compact 🚨 26944517 20266261 1.33
tpcds_q93/datafusion:vortex-compact 🚀 39265845 44323071 0.89
tpcds_q94/datafusion:vortex-compact 28926455 27187629 1.06
tpcds_q95/datafusion:vortex-compact 66596195 67148622 0.99
tpcds_q96/datafusion:vortex-compact 🚀 17494379 23771775 0.74
tpcds_q97/datafusion:vortex-compact 39124934 40352491 0.97
tpcds_q98/datafusion:vortex-compact 31907041 32746102 0.97
tpcds_q99/datafusion:vortex-compact 🚨 34319473 30927258 1.11
datafusion / parquet (1.013x ➖, 1↑ 3↓)
name PR ff7d356 (ns) base 5abaf98 (ns) ratio (PR/base)
tpcds_q01/datafusion:parquet 25588875 26923359 0.95
tpcds_q02/datafusion:parquet 42934780 45535123 0.94
tpcds_q03/datafusion:parquet 13943053 14337021 0.97
tpcds_q04/datafusion:parquet 338118754 334004324 1.01
tpcds_q05/datafusion:parquet 51834751 48582010 1.07
tpcds_q06/datafusion:parquet 26315655 26120895 1.01
tpcds_q07/datafusion:parquet 86867475 81941610 1.06
tpcds_q08/datafusion:parquet 30888967 30255473 1.02
tpcds_q09/datafusion:parquet 43894703 40499983 1.08
tpcds_q10/datafusion:parquet 76904373 74061236 1.04
tpcds_q11/datafusion:parquet 169476878 157314691 1.08
tpcds_q12/datafusion:parquet 🚨 19357943 17503156 1.11
tpcds_q13/datafusion:parquet 81918177 79335843 1.03
tpcds_q14/datafusion:parquet 173200839 168753842 1.03
tpcds_q15/datafusion:parquet 22858415 22682009 1.01
tpcds_q16/datafusion:parquet 33539101 33403872 1.00
tpcds_q17/datafusion:parquet 65968955 68885689 0.96
tpcds_q18/datafusion:parquet 113570304 114767108 0.99
tpcds_q19/datafusion:parquet 24540040 24564409 1.00
tpcds_q20/datafusion:parquet 19346762 19018922 1.02
tpcds_q21/datafusion:parquet 20750699 21452932 0.97
tpcds_q22/datafusion:parquet 🚨 199663008 171680863 1.16
tpcds_q23/datafusion:parquet 165358287 162536527 1.02
tpcds_q24/datafusion:parquet 93168142 93243453 1.00
tpcds_q25/datafusion:parquet 🚨 71912284 65163432 1.10
tpcds_q26/datafusion:parquet 67715754 72694283 0.93
tpcds_q27/datafusion:parquet 149082218 152922658 0.97
tpcds_q28/datafusion:parquet 46960924 48250728 0.97
tpcds_q29/datafusion:parquet 69507677 67852270 1.02
tpcds_q30/datafusion:parquet 🚀 34958449 39257452 0.89
tpcds_q31/datafusion:parquet 75311248 70175903 1.07
tpcds_q32/datafusion:parquet 18301076 17671579 1.04
tpcds_q33/datafusion:parquet 28206638 28841172 0.98
tpcds_q34/datafusion:parquet 22420914 24632951 0.91
tpcds_q35/datafusion:parquet 80312330 79390484 1.01
tpcds_q36/datafusion:parquet 62797282 59884383 1.05
tpcds_q37/datafusion:parquet 20739137 20077547 1.03
tpcds_q38/datafusion:parquet 44818292 44345586 1.01
tpcds_q39/datafusion:parquet 86266979 81167722 1.06
tpcds_q40/datafusion:parquet 24656677 25598869 0.96
tpcds_q41/datafusion:parquet 16828998 16855133 1.00
tpcds_q42/datafusion:parquet 13359714 12970176 1.03
tpcds_q43/datafusion:parquet 18754214 18584768 1.01
tpcds_q44/datafusion:parquet 34899370 34457495 1.01
tpcds_q45/datafusion:parquet 31940506 29774923 1.07
tpcds_q46/datafusion:parquet 34779115 33223338 1.05
tpcds_q47/datafusion:parquet 141214697 136996791 1.03
tpcds_q48/datafusion:parquet 76859547 72370801 1.06
tpcds_q49/datafusion:parquet 61664934 58886676 1.05
tpcds_q50/datafusion:parquet 46497413 44621654 1.04
tpcds_q51/datafusion:parquet 94280725 90456858 1.04
tpcds_q52/datafusion:parquet 14363865 14725739 0.98
tpcds_q53/datafusion:parquet 19750705 18587162 1.06
tpcds_q54/datafusion:parquet 35008269 34774209 1.01
tpcds_q55/datafusion:parquet 12368601 12327451 1.00
tpcds_q56/datafusion:parquet 29374630 30070575 0.98
tpcds_q57/datafusion:parquet 108440751 110634615 0.98
tpcds_q58/datafusion:parquet 57239489 58332846 0.98
tpcds_q59/datafusion:parquet 67628181 64753443 1.04
tpcds_q60/datafusion:parquet 30159744 28720924 1.05
tpcds_q61/datafusion:parquet 46045830 46493621 0.99
tpcds_q62/datafusion:parquet 22907036 23199528 0.99
tpcds_q63/datafusion:parquet 20524527 18999421 1.08
tpcds_q64/datafusion:parquet 319854091 327460489 0.98
tpcds_q65/datafusion:parquet 40451473 40530934 1.00
tpcds_q66/datafusion:parquet 74617936 77997755 0.96
tpcds_q67/datafusion:parquet 163129807 152601334 1.07
tpcds_q68/datafusion:parquet 34118683 34052971 1.00
tpcds_q69/datafusion:parquet 73473654 69444574 1.06
tpcds_q70/datafusion:parquet 34966616 36237552 0.96
tpcds_q71/datafusion:parquet 24099245 23672393 1.02
tpcds_q72/datafusion:parquet 620613638 610944232 1.02
tpcds_q73/datafusion:parquet 23929135 22310291 1.07
tpcds_q74/datafusion:parquet 92228213 94084355 0.98
tpcds_q75/datafusion:parquet 112043904 117103043 0.96
tpcds_q76/datafusion:parquet 31481929 32228016 0.98
tpcds_q77/datafusion:parquet 40928267 42942763 0.95
tpcds_q78/datafusion:parquet 114875059 118580966 0.97
tpcds_q79/datafusion:parquet 28411356 28146404 1.01
tpcds_q80/datafusion:parquet 82531259 79729277 1.04
tpcds_q81/datafusion:parquet 32746758 31502796 1.04
tpcds_q82/datafusion:parquet 20662794 20846768 0.99
tpcds_q83/datafusion:parquet 45445479 43607707 1.04
tpcds_q84/datafusion:parquet 41981067 42299960 0.99
tpcds_q85/datafusion:parquet 158573696 158702351 1.00
tpcds_q86/datafusion:parquet 17035239 16776272 1.02
tpcds_q87/datafusion:parquet 48380250 47224580 1.02
tpcds_q88/datafusion:parquet 62485468 61650767 1.01
tpcds_q89/datafusion:parquet 24269717 22677820 1.07
tpcds_q90/datafusion:parquet 16080059 15746541 1.02
tpcds_q91/datafusion:parquet 63037545 61394831 1.03
tpcds_q92/datafusion:parquet 18303518 19041020 0.96
tpcds_q93/datafusion:parquet 30891377 31741041 0.97
tpcds_q94/datafusion:parquet 23658077 22172260 1.07
tpcds_q95/datafusion:parquet 64891411 63379522 1.02
tpcds_q96/datafusion:parquet 12802718 12901130 0.99
tpcds_q97/datafusion:parquet 32965783 32410334 1.02
tpcds_q98/datafusion:parquet 23263706 23335362 1.00
tpcds_q99/datafusion:parquet 27962562 27608657 1.01
duckdb / vortex-file-compressed (1.017x ➖, 10↑ 19↓)
name PR ff7d356 (ns) base 5abaf98 (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-file-compressed 25652142 23582988 1.09
tpcds_q02/duckdb:vortex-file-compressed 🚨 28817530 23065042 1.25
tpcds_q03/duckdb:vortex-file-compressed 🚀 16988975 19932792 0.85
tpcds_q04/duckdb:vortex-file-compressed 105570096 101543085 1.04
tpcds_q05/duckdb:vortex-file-compressed 39022050 37118563 1.05
tpcds_q06/duckdb:vortex-file-compressed 37609360 37554881 1.00
tpcds_q07/duckdb:vortex-file-compressed 🚀 27198166 30670371 0.89
tpcds_q08/duckdb:vortex-file-compressed 30817753 32773813 0.94
tpcds_q09/duckdb:vortex-file-compressed 16542009 17258576 0.96
tpcds_q10/duckdb:vortex-file-compressed 41202998 43193080 0.95
tpcds_q11/duckdb:vortex-file-compressed 🚀 69953558 79027888 0.89
tpcds_q12/duckdb:vortex-file-compressed 17190350 17359006 0.99
tpcds_q13/duckdb:vortex-file-compressed 35081972 35883206 0.98
tpcds_q14/duckdb:vortex-file-compressed 105095335 107708318 0.98
tpcds_q15/duckdb:vortex-file-compressed 29799779 29360691 1.01
tpcds_q16/duckdb:vortex-file-compressed 🚨 27504777 24741405 1.11
tpcds_q17/duckdb:vortex-file-compressed 50587869 49734709 1.02
tpcds_q18/duckdb:vortex-file-compressed 44133636 43849223 1.01
tpcds_q19/duckdb:vortex-file-compressed 34072864 37422317 0.91
tpcds_q20/duckdb:vortex-file-compressed 17658879 17323322 1.02
tpcds_q21/duckdb:vortex-file-compressed 17581577 16925892 1.04
tpcds_q22/duckdb:vortex-file-compressed 🚨 86145773 78247653 1.10
tpcds_q23/duckdb:vortex-file-compressed 🚨 101221137 89612180 1.13
tpcds_q24/duckdb:vortex-file-compressed 55046689 51677036 1.07
tpcds_q25/duckdb:vortex-file-compressed 🚨 44184158 39048252 1.13
tpcds_q26/duckdb:vortex-file-compressed 22010114 20131510 1.09
tpcds_q27/duckdb:vortex-file-compressed 28394175 31340156 0.91
tpcds_q28/duckdb:vortex-file-compressed 🚨 14012854 12713558 1.10
tpcds_q29/duckdb:vortex-file-compressed 49833689 49812053 1.00
tpcds_q30/duckdb:vortex-file-compressed 26845611 27416250 0.98
tpcds_q31/duckdb:vortex-file-compressed 32268053 32533558 0.99
tpcds_q32/duckdb:vortex-file-compressed 14950401 15173383 0.99
tpcds_q33/duckdb:vortex-file-compressed 27088227 28890614 0.94
tpcds_q34/duckdb:vortex-file-compressed 28030215 30082187 0.93
tpcds_q35/duckdb:vortex-file-compressed 69597986 71016205 0.98
tpcds_q36/duckdb:vortex-file-compressed 27615553 27578729 1.00
tpcds_q37/duckdb:vortex-file-compressed 21947261 20736082 1.06
tpcds_q38/duckdb:vortex-file-compressed 39751214 41354375 0.96
tpcds_q39/duckdb:vortex-file-compressed 🚨 37645259 31800881 1.18
tpcds_q40/duckdb:vortex-file-compressed 🚨 23459018 20132776 1.17
tpcds_q41/duckdb:vortex-file-compressed 13847868 13448571 1.03
tpcds_q42/duckdb:vortex-file-compressed 🚀 14379961 17251242 0.83
tpcds_q43/duckdb:vortex-file-compressed 🚨 23238605 19275958 1.21
tpcds_q44/duckdb:vortex-file-compressed 23969064 22739182 1.05
tpcds_q45/duckdb:vortex-file-compressed 34493639 33552211 1.03
tpcds_q46/duckdb:vortex-file-compressed 32578129 33882258 0.96
tpcds_q47/duckdb:vortex-file-compressed 56153133 55274845 1.02
tpcds_q48/duckdb:vortex-file-compressed 34923381 35814350 0.98
tpcds_q49/duckdb:vortex-file-compressed 37554238 40975489 0.92
tpcds_q50/duckdb:vortex-file-compressed 30313276 28486201 1.06
tpcds_q51/duckdb:vortex-file-compressed 115822212 111314795 1.04
tpcds_q52/duckdb:vortex-file-compressed 🚀 13628029 16195828 0.84
tpcds_q53/duckdb:vortex-file-compressed 24429191 23958317 1.02
tpcds_q54/duckdb:vortex-file-compressed 31343956 33053657 0.95
tpcds_q55/duckdb:vortex-file-compressed 🚀 14103845 15727815 0.90
tpcds_q56/duckdb:vortex-file-compressed 🚀 27001876 30022464 0.90
tpcds_q57/duckdb:vortex-file-compressed 🚨 44522761 40183535 1.11
tpcds_q58/duckdb:vortex-file-compressed 31975223 33322177 0.96
tpcds_q59/duckdb:vortex-file-compressed 🚨 59917117 39081805 1.53
tpcds_q60/duckdb:vortex-file-compressed 28419698 27778818 1.02
tpcds_q61/duckdb:vortex-file-compressed 32305078 33905414 0.95
tpcds_q62/duckdb:vortex-file-compressed 16545333 15966631 1.04
tpcds_q63/duckdb:vortex-file-compressed 24706393 24291754 1.02
tpcds_q64/duckdb:vortex-file-compressed 102368407 104226862 0.98
tpcds_q65/duckdb:vortex-file-compressed 24868246 24423281 1.02
tpcds_q66/duckdb:vortex-file-compressed 31680868 30676492 1.03
tpcds_q67/duckdb:vortex-file-compressed 147136158 153992483 0.96
tpcds_q68/duckdb:vortex-file-compressed 35765415 36132912 0.99
tpcds_q69/duckdb:vortex-file-compressed 42176928 45692626 0.92
tpcds_q70/duckdb:vortex-file-compressed 🚨 39433617 35627039 1.11
tpcds_q71/duckdb:vortex-file-compressed 22204923 24422909 0.91
tpcds_q72/duckdb:vortex-file-compressed 🚨 186683085 155205635 1.20
tpcds_q73/duckdb:vortex-file-compressed 🚀 27062773 31007935 0.87
tpcds_q74/duckdb:vortex-file-compressed 45102546 49366207 0.91
tpcds_q75/duckdb:vortex-file-compressed 53740172 52871470 1.02
tpcds_q76/duckdb:vortex-file-compressed 🚀 20291939 23256701 0.87
tpcds_q77/duckdb:vortex-file-compressed 🚨 29734863 25120595 1.18
tpcds_q78/duckdb:vortex-file-compressed 🚨 83106818 70790412 1.17
tpcds_q79/duckdb:vortex-file-compressed 🚀 26480943 30292519 0.87
tpcds_q80/duckdb:vortex-file-compressed 51005629 50806703 1.00
tpcds_q81/duckdb:vortex-file-compressed 33002145 30836232 1.07
tpcds_q82/duckdb:vortex-file-compressed 49101297 48420327 1.01
tpcds_q83/duckdb:vortex-file-compressed 🚨 35490915 29459862 1.20
tpcds_q84/duckdb:vortex-file-compressed 18522071 17572181 1.05
tpcds_q85/duckdb:vortex-file-compressed 49841917 46165119 1.08
tpcds_q86/duckdb:vortex-file-compressed 18443427 18336563 1.01
tpcds_q87/duckdb:vortex-file-compressed 45239734 45040735 1.00
tpcds_q88/duckdb:vortex-file-compressed 58890198 60285437 0.98
tpcds_q89/duckdb:vortex-file-compressed 26022655 24914641 1.04
tpcds_q90/duckdb:vortex-file-compressed 12257800 11876894 1.03
tpcds_q91/duckdb:vortex-file-compressed 24442779 23849937 1.02
tpcds_q92/duckdb:vortex-file-compressed 19940692 18818581 1.06
tpcds_q93/duckdb:vortex-file-compressed 32420226 29747623 1.09
tpcds_q94/duckdb:vortex-file-compressed 🚨 26950922 24208801 1.11
tpcds_q95/duckdb:vortex-file-compressed 🚨 149996929 129803593 1.16
tpcds_q96/duckdb:vortex-file-compressed 14273883 15612647 0.91
tpcds_q97/duckdb:vortex-file-compressed 42431552 38823572 1.09
tpcds_q98/duckdb:vortex-file-compressed 21056066 21342343 0.99
tpcds_q99/duckdb:vortex-file-compressed 🚨 24907817 20226994 1.23
duckdb / vortex-compact (0.860x ✅, 54↑ 15↓)
name PR ff7d356 (ns) base 5abaf98 (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-compact 🚨 29718825 25671250 1.16
tpcds_q02/duckdb:vortex-compact 🚨 40291104 27261182 1.48
tpcds_q03/duckdb:vortex-compact 47958315 47090889 1.02
tpcds_q04/duckdb:vortex-compact 106497805 116691419 0.91
tpcds_q05/duckdb:vortex-compact 🚀 40868468 53676984 0.76
tpcds_q06/duckdb:vortex-compact 🚀 44638218 51590265 0.87
tpcds_q07/duckdb:vortex-compact 🚀 45195167 62870119 0.72
tpcds_q08/duckdb:vortex-compact 🚀 44552788 111572545 0.40
tpcds_q09/duckdb:vortex-compact 🚀 21510463 27092101 0.79
tpcds_q10/duckdb:vortex-compact 🚀 57564774 80496609 0.72
tpcds_q11/duckdb:vortex-compact 🚀 84101005 94809451 0.89
tpcds_q12/duckdb:vortex-compact 23186709 22058040 1.05
tpcds_q13/duckdb:vortex-compact 🚀 57988933 86646279 0.67
tpcds_q14/duckdb:vortex-compact 130242289 143025336 0.91
tpcds_q15/duckdb:vortex-compact 33777570 36019657 0.94
tpcds_q16/duckdb:vortex-compact 31983785 33001512 0.97
tpcds_q17/duckdb:vortex-compact 🚀 67617731 90968472 0.74
tpcds_q18/duckdb:vortex-compact 🚀 53092090 65284718 0.81
tpcds_q19/duckdb:vortex-compact 🚀 47200782 67979403 0.69
tpcds_q20/duckdb:vortex-compact 23919221 22404041 1.07
tpcds_q21/duckdb:vortex-compact 20775944 19632991 1.06
tpcds_q22/duckdb:vortex-compact 81968804 81146352 1.01
tpcds_q23/duckdb:vortex-compact 🚀 117435343 133719369 0.88
tpcds_q24/duckdb:vortex-compact 🚀 60310304 80152688 0.75
tpcds_q25/duckdb:vortex-compact 🚀 57163093 63695909 0.90
tpcds_q26/duckdb:vortex-compact 32984453 36334110 0.91
tpcds_q27/duckdb:vortex-compact 🚀 46506705 67842777 0.69
tpcds_q28/duckdb:vortex-compact 🚨 27910177 23335330 1.20
tpcds_q29/duckdb:vortex-compact 🚀 61576761 89102200 0.69
tpcds_q30/duckdb:vortex-compact 🚨 35400691 31950110 1.11
tpcds_q31/duckdb:vortex-compact 🚀 38250074 51263810 0.75
tpcds_q32/duckdb:vortex-compact 🚨 23044897 20153636 1.14
tpcds_q33/duckdb:vortex-compact 🚀 35663823 48325298 0.74
tpcds_q34/duckdb:vortex-compact 🚀 32318498 56997745 0.57
tpcds_q35/duckdb:vortex-compact 🚀 81930302 104707288 0.78
tpcds_q36/duckdb:vortex-compact 🚀 38398630 47901525 0.80
tpcds_q37/duckdb:vortex-compact 🚨 26780432 23387639 1.15
tpcds_q38/duckdb:vortex-compact 🚀 46420974 58209147 0.80
tpcds_q39/duckdb:vortex-compact 🚨 41145620 30419142 1.35
tpcds_q40/duckdb:vortex-compact 🚨 26973382 22042760 1.22
tpcds_q41/duckdb:vortex-compact 15591012 14844913 1.05
tpcds_q42/duckdb:vortex-compact 🚀 21615216 24588020 0.88
tpcds_q43/duckdb:vortex-compact 🚀 32560933 39260833 0.83
tpcds_q44/duckdb:vortex-compact 🚀 32551785 37222777 0.87
tpcds_q45/duckdb:vortex-compact 40474954 40402388 1.00
tpcds_q46/duckdb:vortex-compact 🚀 45280233 73079697 0.62
tpcds_q47/duckdb:vortex-compact 65995207 72555471 0.91
tpcds_q48/duckdb:vortex-compact 🚀 49795984 76540071 0.65
tpcds_q49/duckdb:vortex-compact 🚀 57748518 64770570 0.89
tpcds_q50/duckdb:vortex-compact 🚀 39756900 62931059 0.63
tpcds_q51/duckdb:vortex-compact 117107534 121598440 0.96
tpcds_q52/duckdb:vortex-compact 🚀 20171537 27349202 0.74
tpcds_q53/duckdb:vortex-compact 🚀 35980083 47216361 0.76
tpcds_q54/duckdb:vortex-compact 🚀 41267607 50248335 0.82
tpcds_q55/duckdb:vortex-compact 🚀 20086815 26153589 0.77
tpcds_q56/duckdb:vortex-compact 🚀 35755027 48307369 0.74
tpcds_q57/duckdb:vortex-compact 🚨 48418985 41696995 1.16
tpcds_q58/duckdb:vortex-compact 45022776 46057517 0.98
tpcds_q59/duckdb:vortex-compact 🚨 69098914 58851274 1.17
tpcds_q60/duckdb:vortex-compact 🚀 38613968 50601607 0.76
tpcds_q61/duckdb:vortex-compact 🚀 57320080 91816461 0.62
tpcds_q62/duckdb:vortex-compact 🚨 22240803 19343379 1.15
tpcds_q63/duckdb:vortex-compact 🚀 35218309 45242479 0.78
tpcds_q64/duckdb:vortex-compact 🚀 132495591 171807301 0.77
tpcds_q65/duckdb:vortex-compact 🚀 32836917 41606763 0.79
tpcds_q66/duckdb:vortex-compact 44107142 40781605 1.08
tpcds_q67/duckdb:vortex-compact 164499211 166797037 0.99
tpcds_q68/duckdb:vortex-compact 🚀 47871588 74988687 0.64
tpcds_q69/duckdb:vortex-compact 🚀 59494798 83002651 0.72
tpcds_q70/duckdb:vortex-compact 🚀 61622634 72086937 0.85
tpcds_q71/duckdb:vortex-compact 🚀 32494394 45298366 0.72
tpcds_q72/duckdb:vortex-compact 197063961 188787506 1.04
tpcds_q73/duckdb:vortex-compact 🚀 30824528 53985645 0.57
tpcds_q74/duckdb:vortex-compact 🚀 51303912 65440902 0.78
tpcds_q75/duckdb:vortex-compact 66544840 68471960 0.97
tpcds_q76/duckdb:vortex-compact 35315186 37963248 0.93
tpcds_q77/duckdb:vortex-compact 🚀 39757970 48871260 0.81
tpcds_q78/duckdb:vortex-compact 93348305 85242587 1.10
tpcds_q79/duckdb:vortex-compact 🚀 42986300 90365165 0.48
tpcds_q80/duckdb:vortex-compact 74243874 82207447 0.90
tpcds_q81/duckdb:vortex-compact 38956603 35535738 1.10
tpcds_q82/duckdb:vortex-compact 52379995 50823238 1.03
tpcds_q83/duckdb:vortex-compact 39089063 36969212 1.06
tpcds_q84/duckdb:vortex-compact 🚨 23607988 21108281 1.12
tpcds_q85/duckdb:vortex-compact 64490514 70002818 0.92
tpcds_q86/duckdb:vortex-compact 🚨 25198029 19800937 1.27
tpcds_q87/duckdb:vortex-compact 🚀 50224857 61009378 0.82
tpcds_q88/duckdb:vortex-compact 🚀 87810881 238041765 0.37
tpcds_q89/duckdb:vortex-compact 🚀 34919062 45135832 0.77
tpcds_q90/duckdb:vortex-compact 🚀 13199191 18269449 0.72
tpcds_q91/duckdb:vortex-compact 🚀 45790345 55853531 0.82
tpcds_q92/duckdb:vortex-compact 🚨 44405099 34887753 1.27
tpcds_q93/duckdb:vortex-compact 35552148 37124165 0.96
tpcds_q94/duckdb:vortex-compact 29515667 32332234 0.91
tpcds_q95/duckdb:vortex-compact 🚨 173948981 140309667 1.24
tpcds_q96/duckdb:vortex-compact 🚀 17726982 39724939 0.45
tpcds_q97/duckdb:vortex-compact 46317677 51426353 0.90
tpcds_q98/duckdb:vortex-compact 🚀 29689183 33217383 0.89
tpcds_q99/duckdb:vortex-compact 28515344 26031757 1.10
duckdb / parquet (1.018x ➖, 0↑ 2↓)
name PR ff7d356 (ns) base 5abaf98 (ns) ratio (PR/base)
tpcds_q01/duckdb:parquet 30974072 32329578 0.96
tpcds_q02/duckdb:parquet 24982851 25851151 0.97
tpcds_q03/duckdb:parquet 13688378 13208998 1.04
tpcds_q04/duckdb:parquet 171435966 174750887 0.98
tpcds_q05/duckdb:parquet 33809192 32608521 1.04
tpcds_q06/duckdb:parquet 35530124 34540099 1.03
tpcds_q07/duckdb:parquet 25536864 24890049 1.03
tpcds_q08/duckdb:parquet 31203578 30301638 1.03
tpcds_q09/duckdb:parquet 46082151 45112382 1.02
tpcds_q10/duckdb:parquet 40844299 38462631 1.06
tpcds_q11/duckdb:parquet 94935924 97603597 0.97
tpcds_q12/duckdb:parquet 18206277 17770760 1.02
tpcds_q13/duckdb:parquet 36111107 36442512 0.99
tpcds_q14/duckdb:parquet 107953495 104785592 1.03
tpcds_q15/duckdb:parquet 32719735 31652746 1.03
tpcds_q16/duckdb:parquet 23674044 23318806 1.02
tpcds_q17/duckdb:parquet 40801978 39745006 1.03
tpcds_q18/duckdb:parquet 50272325 50583064 0.99
tpcds_q19/duckdb:parquet 33717673 32825776 1.03
tpcds_q20/duckdb:parquet 19785753 19524965 1.01
tpcds_q21/duckdb:parquet 12424021 12079133 1.03
tpcds_q22/duckdb:parquet 🚨 81294042 73417990 1.11
tpcds_q23/duckdb:parquet 88872008 82573092 1.08
tpcds_q24/duckdb:parquet 51036390 49340484 1.03
tpcds_q25/duckdb:parquet 39103884 37195163 1.05
tpcds_q26/duckdb:parquet 42775299 42490976 1.01
tpcds_q27/duckdb:parquet 55930469 55507240 1.01
tpcds_q28/duckdb:parquet 44746601 42817405 1.05
tpcds_q29/duckdb:parquet 40096863 39943665 1.00
tpcds_q30/duckdb:parquet 38508189 39484912 0.98
tpcds_q31/duckdb:parquet 28521183 29785021 0.96
tpcds_q32/duckdb:parquet 13454172 13626605 0.99
tpcds_q33/duckdb:parquet 24300659 25504917 0.95
tpcds_q34/duckdb:parquet 24525220 24125593 1.02
tpcds_q35/duckdb:parquet 66442293 64657492 1.03
tpcds_q36/duckdb:parquet 23536495 23195839 1.01
tpcds_q37/duckdb:parquet 16583095 15710807 1.06
tpcds_q38/duckdb:parquet 40413547 39569197 1.02
tpcds_q39/duckdb:parquet 34334876 34361379 1.00
tpcds_q40/duckdb:parquet 21779852 21849574 1.00
tpcds_q41/duckdb:parquet 9532016 9721883 0.98
tpcds_q42/duckdb:parquet 13633054 13518944 1.01
tpcds_q43/duckdb:parquet 20267901 18826188 1.08
tpcds_q44/duckdb:parquet 27555580 28130525 0.98
tpcds_q45/duckdb:parquet 30837396 29965722 1.03
tpcds_q46/duckdb:parquet 51257609 49901196 1.03
tpcds_q47/duckdb:parquet 53253417 50819531 1.05
tpcds_q48/duckdb:parquet 33774608 33239465 1.02
tpcds_q49/duckdb:parquet 30935395 28878101 1.07
tpcds_q50/duckdb:parquet 27554647 26752633 1.03
tpcds_q51/duckdb:parquet 108719337 107450013 1.01
tpcds_q52/duckdb:parquet 13317943 13018914 1.02
tpcds_q53/duckdb:parquet 19998572 20267447 0.99
tpcds_q54/duckdb:parquet 30955588 30179348 1.03
tpcds_q55/duckdb:parquet 12936067 12818355 1.01
tpcds_q56/duckdb:parquet 25050085 24698324 1.01
tpcds_q57/duckdb:parquet 40073773 39930277 1.00
tpcds_q58/duckdb:parquet 26957603 28234532 0.95
tpcds_q59/duckdb:parquet 37318302 37659498 0.99
tpcds_q60/duckdb:parquet 26308762 26580451 0.99
tpcds_q61/duckdb:parquet 34617270 35563960 0.97
tpcds_q62/duckdb:parquet 13307741 13386742 0.99
tpcds_q63/duckdb:parquet 18846936 18885401 1.00
tpcds_q64/duckdb:parquet 84249704 83271959 1.01
tpcds_q65/duckdb:parquet 23441357 23833005 0.98
tpcds_q66/duckdb:parquet 30641282 30336648 1.01
tpcds_q67/duckdb:parquet 146374291 143404738 1.02
tpcds_q68/duckdb:parquet 40306472 40329727 1.00
tpcds_q69/duckdb:parquet 40861079 39642701 1.03
tpcds_q70/duckdb:parquet 24487909 22990885 1.07
tpcds_q71/duckdb:parquet 24498082 24150289 1.01
tpcds_q72/duckdb:parquet 173799571 169949484 1.02
tpcds_q73/duckdb:parquet 20632429 20694476 1.00
tpcds_q74/duckdb:parquet 133619735 130534211 1.02
tpcds_q75/duckdb:parquet 62240853 60223944 1.03
tpcds_q76/duckdb:parquet 22791543 21986435 1.04
tpcds_q77/duckdb:parquet 26233169 25652280 1.02
tpcds_q78/duckdb:parquet 81424950 79180763 1.03
tpcds_q79/duckdb:parquet 31779920 31069071 1.02
tpcds_q80/duckdb:parquet 47738102 48066399 0.99
tpcds_q81/duckdb:parquet 38572576 35376386 1.09
tpcds_q82/duckdb:parquet 18698569 17846097 1.05
tpcds_q83/duckdb:parquet 19966039 19013330 1.05
tpcds_q84/duckdb:parquet 21639254 22488418 0.96
tpcds_q85/duckdb:parquet 44266821 43716960 1.01
tpcds_q86/duckdb:parquet 14830266 14562647 1.02
tpcds_q87/duckdb:parquet 42165640 42284917 1.00
tpcds_q88/duckdb:parquet 55989788 53560301 1.05
tpcds_q89/duckdb:parquet 23429607 22395532 1.05
tpcds_q90/duckdb:parquet 9413768 8888706 1.06
tpcds_q91/duckdb:parquet 26096560 26491971 0.99
tpcds_q92/duckdb:parquet 14577723 14102009 1.03
tpcds_q93/duckdb:parquet 35096961 33622930 1.04
tpcds_q94/duckdb:parquet 18947763 19084324 0.99
tpcds_q95/duckdb:parquet 🚨 156552778 127862956 1.22
tpcds_q96/duckdb:parquet 11194632 11273496 0.99
tpcds_q97/duckdb:parquet 40793797 39707326 1.03
tpcds_q98/duckdb:parquet 25015097 24700921 1.01
tpcds_q99/duckdb:parquet 21518954 20882445 1.03
duckdb / duckdb (1.019x ➖, 0↑ 1↓)
name PR ff7d356 (ns) base 5abaf98 (ns) ratio (PR/base)
tpcds_q01/duckdb:duckdb 22220670 24318518 0.91
tpcds_q02/duckdb:duckdb 19828951 20716859 0.96
tpcds_q03/duckdb:duckdb 11113219 11388556 0.98
tpcds_q04/duckdb:duckdb 183392576 186830778 0.98
tpcds_q05/duckdb:duckdb 22553800 21830948 1.03
tpcds_q06/duckdb:duckdb 29844259 29195383 1.02
tpcds_q07/duckdb:duckdb 42860319 43026089 1.00
tpcds_q08/duckdb:duckdb 122377931 121658248 1.01
tpcds_q09/duckdb:duckdb 21487882 21100794 1.02
tpcds_q10/duckdb:duckdb 29193737 27985386 1.04
tpcds_q11/duckdb:duckdb 96477450 92981305 1.04
tpcds_q12/duckdb:duckdb 15290398 14657873 1.04
tpcds_q13/duckdb:duckdb 28660913 27436700 1.04
tpcds_q14/duckdb:duckdb 94350896 97901889 0.96
tpcds_q15/duckdb:duckdb 27328392 27064959 1.01
tpcds_q16/duckdb:duckdb 20980288 20902074 1.00
tpcds_q17/duckdb:duckdb 26485202 25921452 1.02
tpcds_q18/duckdb:duckdb 50320317 51694200 0.97
tpcds_q19/duckdb:duckdb 21104568 21439640 0.98
tpcds_q20/duckdb:duckdb 15723942 15863659 0.99
tpcds_q21/duckdb:duckdb 8299703 8191242 1.01
tpcds_q22/duckdb:duckdb 66588751 68390855 0.97
tpcds_q23/duckdb:duckdb 77949488 79219694 0.98
tpcds_q24/duckdb:duckdb 27559471 26233386 1.05
tpcds_q25/duckdb:duckdb 20136373 19774712 1.02
tpcds_q26/duckdb:duckdb 30257261 29883242 1.01
tpcds_q27/duckdb:duckdb 43831359 43635036 1.00
tpcds_q28/duckdb:duckdb 26303009 25270560 1.04
tpcds_q29/duckdb:duckdb 24041564 23787134 1.01
tpcds_q30/duckdb:duckdb 33312652 32042986 1.04
tpcds_q31/duckdb:duckdb 57123256 54280026 1.05
tpcds_q32/duckdb:duckdb 9146225 8764930 1.04
tpcds_q33/duckdb:duckdb 17401620 16539815 1.05
tpcds_q34/duckdb:duckdb 19989817 19226833 1.04
tpcds_q35/duckdb:duckdb 39535417 39242873 1.01
tpcds_q36/duckdb:duckdb 76315031 75088316 1.02
tpcds_q37/duckdb:duckdb 9768479 9515673 1.03
tpcds_q38/duckdb:duckdb 34914916 34741633 1.00
tpcds_q39/duckdb:duckdb 29782236 28929898 1.03
tpcds_q40/duckdb:duckdb 16647738 15762081 1.06
tpcds_q41/duckdb:duckdb 10396855 10091254 1.03
tpcds_q42/duckdb:duckdb 9784049 9361627 1.05
tpcds_q43/duckdb:duckdb 15851834 15510981 1.02
tpcds_q44/duckdb:duckdb 16723972 15819712 1.06
tpcds_q45/duckdb:duckdb 20336648 19413130 1.05
tpcds_q46/duckdb:duckdb 41675265 40177037 1.04
tpcds_q47/duckdb:duckdb 50040327 47466269 1.05
tpcds_q48/duckdb:duckdb 25913461 25804110 1.00
tpcds_q49/duckdb:duckdb 22256920 21429067 1.04
tpcds_q50/duckdb:duckdb 16764531 17077947 0.98
tpcds_q51/duckdb:duckdb 103781838 103538762 1.00
tpcds_q52/duckdb:duckdb 9998207 9786518 1.02
tpcds_q53/duckdb:duckdb 18462735 18301650 1.01
tpcds_q54/duckdb:duckdb 20495569 20089937 1.02
tpcds_q55/duckdb:duckdb 10999193 10560422 1.04
tpcds_q56/duckdb:duckdb 18006843 17289138 1.04
tpcds_q57/duckdb:duckdb 38552590 38050062 1.01
tpcds_q58/duckdb:duckdb 18013900 16983320 1.06
tpcds_q59/duckdb:duckdb 37992997 37907162 1.00
tpcds_q60/duckdb:duckdb 19302957 18633450 1.04
tpcds_q61/duckdb:duckdb 17314514 17074542 1.01
tpcds_q62/duckdb:duckdb 10791644 10680070 1.01
tpcds_q63/duckdb:duckdb 17918657 16990124 1.05
tpcds_q64/duckdb:duckdb 61708896 60798139 1.01
tpcds_q65/duckdb:duckdb 38185620 38964181 0.98
tpcds_q66/duckdb:duckdb 28483164 29895931 0.95
tpcds_q67/duckdb:duckdb 142278103 140251314 1.01
tpcds_q68/duckdb:duckdb 29687628 27717440 1.07
tpcds_q69/duckdb:duckdb 29547152 28759397 1.03
tpcds_q70/duckdb:duckdb 17761996 17603161 1.01
tpcds_q71/duckdb:duckdb 16841864 16690757 1.01
tpcds_q72/duckdb:duckdb 48426853 49337987 0.98
tpcds_q73/duckdb:duckdb 14962707 14103118 1.06
tpcds_q74/duckdb:duckdb 153438427 148864326 1.03
tpcds_q75/duckdb:duckdb 49274831 48421094 1.02
tpcds_q76/duckdb:duckdb 15424049 15575663 0.99
tpcds_q77/duckdb:duckdb 16296152 14991703 1.09
tpcds_q78/duckdb:duckdb 70148084 67451573 1.04
tpcds_q79/duckdb:duckdb 21132134 21322967 0.99
tpcds_q80/duckdb:duckdb 33387032 33860208 0.99
tpcds_q81/duckdb:duckdb 43365559 42116544 1.03
tpcds_q82/duckdb:duckdb 11557590 10936455 1.06
tpcds_q83/duckdb:duckdb 12315599 12383237 0.99
tpcds_q84/duckdb:duckdb 16358079 15751574 1.04
tpcds_q85/duckdb:duckdb 28634780 28195739 1.02
tpcds_q86/duckdb:duckdb 13035937 13138293 0.99
tpcds_q87/duckdb:duckdb 38406632 37137540 1.03
tpcds_q88/duckdb:duckdb 30363450 30412204 1.00
tpcds_q89/duckdb:duckdb 24029567 22541904 1.07
tpcds_q90/duckdb:duckdb 7057374 7022295 1.00
tpcds_q91/duckdb:duckdb 15563547 15793335 0.99
tpcds_q92/duckdb:duckdb 11255044 10811566 1.04
tpcds_q93/duckdb:duckdb 25928045 24776073 1.05
tpcds_q94/duckdb:duckdb 15922997 15450021 1.03
tpcds_q95/duckdb:duckdb 🚨 141324236 116113193 1.22
tpcds_q96/duckdb:duckdb 6318516 6396274 0.99
tpcds_q97/duckdb:duckdb 35924629 34179393 1.05
tpcds_q98/duckdb:duckdb 22043041 22311808 0.99
tpcds_q99/duckdb:duckdb 17818098 18013069 0.99
File Size Changes (48 files changed, -0.1% overall, 34↑ 14↓)
File Scale Format Base HEAD Change %
customer_demographics.vortex 1.0 vortex-compact 424.18 KB 649.64 KB +225.47 KB +53.2%
web_page.vortex 1.0 vortex-compact 25.01 KB 27.87 KB +2.86 KB +11.4%
date_dim.vortex 1.0 vortex-file-compressed 953.68 KB 1.02 MB +94.27 KB +9.9%
income_band.vortex 1.0 vortex-compact 5.56 KB 6.01 KB +464 B +8.2%
date_dim.vortex 1.0 vortex-compact 140.28 KB 151.55 KB +11.27 KB +8.0%
income_band.vortex 1.0 vortex-file-compressed 5.77 KB 6.22 KB +464 B +7.9%
web_site.vortex 1.0 vortex-compact 42.19 KB 45.34 KB +3.15 KB +7.5%
store.vortex 1.0 vortex-compact 43.22 KB 45.79 KB +2.57 KB +5.9%
call_center.vortex 1.0 vortex-compact 47.43 KB 50.18 KB +2.74 KB +5.8%
household_demographics.vortex 1.0 vortex-compact 10.29 KB 10.82 KB +544 B +5.2%
web_page.vortex 1.0 vortex-file-compressed 30.53 KB 31.95 KB +1.42 KB +4.7%
household_demographics.vortex 1.0 vortex-file-compressed 16.55 KB 17.08 KB +544 B +3.2%
promotion.vortex 1.0 vortex-compact 50.31 KB 51.54 KB +1.23 KB +2.4%
ship_mode.vortex 1.0 vortex-compact 10.73 KB 10.98 KB +260 B +2.4%
call_center.vortex 1.0 vortex-file-compressed 53.73 KB 54.97 KB +1.24 KB +2.3%
time_dim.vortex 1.0 vortex-compact 96.59 KB 97.38 KB +808 B +0.8%
reason.vortex 1.0 vortex-compact 5.96 KB 6.00 KB +44 B +0.7%
store.vortex 1.0 vortex-file-compressed 49.23 KB 49.52 KB +304 B +0.6%
warehouse.vortex 1.0 vortex-compact 22.14 KB 22.26 KB +128 B +0.6%
promotion.vortex 1.0 vortex-file-compressed 59.95 KB 60.22 KB +284 B +0.5%
catalog_page.vortex 1.0 vortex-compact 362.44 KB 363.54 KB +1.10 KB +0.3%
catalog_page.vortex 1.0 vortex-file-compressed 565.16 KB 566.82 KB +1.66 KB +0.3%
web_returns.vortex 1.0 vortex-file-compressed 3.55 MB 3.55 MB +4.35 KB +0.1%
catalog_returns.vortex 1.0 vortex-file-compressed 7.16 MB 7.16 MB +4.92 KB +0.1%
item.vortex 1.0 vortex-file-compressed 1.64 MB 1.64 MB +872 B +0.1%
customer_demographics.vortex 1.0 vortex-file-compressed 1.49 MB 1.49 MB +672 B +0.0%
store_returns.vortex 1.0 vortex-file-compressed 10.97 MB 10.97 MB +3.73 KB +0.0%
customer.vortex 1.0 vortex-compact 3.29 MB 3.29 MB +1.09 KB +0.0%
web_sales.vortex 1.0 vortex-file-compressed 34.20 MB 34.20 MB +5.54 KB +0.0%
catalog_sales.vortex 1.0 vortex-file-compressed 70.44 MB 70.45 MB +5.47 KB +0.0%
store_sales.vortex 1.0 vortex-file-compressed 96.33 MB 96.34 MB +4.16 KB +0.0%
inventory.vortex 1.0 vortex-compact 16.07 MB 16.07 MB +624 B +0.0%
inventory.vortex 1.0 vortex-file-compressed 36.64 MB 36.64 MB +720 B +0.0%
customer.vortex 1.0 vortex-file-compressed 4.27 MB 4.27 MB +16 B +0.0%
customer_address.vortex 1.0 vortex-file-compressed 828.69 KB 826.98 KB 1.71 KB -0.2%
web_returns.vortex 1.0 vortex-compact 3.00 MB 2.99 MB 7.84 KB -0.3%
catalog_sales.vortex 1.0 vortex-compact 59.49 MB 59.32 MB 176.25 KB -0.3%
store_sales.vortex 1.0 vortex-compact 78.12 MB 77.87 MB 253.45 KB -0.3%
web_sales.vortex 1.0 vortex-compact 29.45 MB 29.35 MB 99.73 KB -0.3%
catalog_returns.vortex 1.0 vortex-compact 6.04 MB 6.02 MB 25.91 KB -0.4%
store_returns.vortex 1.0 vortex-compact 9.36 MB 9.31 MB 53.14 KB -0.6%
item.vortex 1.0 vortex-compact 1000.84 KB 994.93 KB 5.92 KB -0.6%
warehouse.vortex 1.0 vortex-file-compressed 24.09 KB 23.86 KB 232 B -0.9%
web_site.vortex 1.0 vortex-file-compressed 54.72 KB 54.11 KB 624 B -1.1%
ship_mode.vortex 1.0 vortex-file-compressed 13.31 KB 13.15 KB 164 B -1.2%
reason.vortex 1.0 vortex-file-compressed 7.65 KB 7.26 KB 404 B -5.2%
time_dim.vortex 1.0 vortex-file-compressed 434.02 KB 390.62 KB 43.41 KB -10.0%
customer_address.vortex 1.0 vortex-compact 638.84 KB 558.66 KB 80.18 KB -12.6%

Totals:

  • vortex-compact: 207.94 MB → 207.50 MB (-0.2%)
  • vortex-file-compressed: 269.96 MB → 270.05 MB (+0.0%)

@github-actions

github-actions Bot commented Jul 14, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +7.2%
Engines: DataFusion No clear signal (+7.6%, environment too noisy confidence) · DuckDB No clear signal (+6.8%, environment too noisy confidence)
Vortex (geomean): 1.003x ➖
Parquet (geomean): 0.935x ➖
Shifts: Parquet (control) -6.5% · Median polish -1.4%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (0.997x ➖, 0↑ 0↓)
name PR ff7d356 (ns) base 5abaf98 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 42220564 37821225 1.12
fineweb_q01/datafusion:vortex-file-compressed 491833615 687153961 0.72
fineweb_q02/datafusion:vortex-file-compressed 777610795 646858256 1.20
fineweb_q03/datafusion:vortex-file-compressed 1112118550 1108861771 1.00
fineweb_q04/datafusion:vortex-file-compressed 1223621703 1174376137 1.04
fineweb_q05/datafusion:vortex-file-compressed 1079434621 1082741716 1.00
fineweb_q06/datafusion:vortex-file-compressed 1248423931 1327233215 0.94
fineweb_q07/datafusion:vortex-file-compressed 1112339282 1089701495 1.02
fineweb_q08/datafusion:vortex-file-compressed 478253189 470441403 1.02
datafusion / vortex-compact (1.064x ➖, 0↑ 1↓)
name PR ff7d356 (ns) base 5abaf98 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 35872518 39107929 0.92
fineweb_q01/datafusion:vortex-compact 🚨 693355456 496823841 1.40
fineweb_q02/datafusion:vortex-compact 538129022 598479259 0.90
fineweb_q03/datafusion:vortex-compact 1435083921 1376176463 1.04
fineweb_q04/datafusion:vortex-compact 1800586636 1597091571 1.13
fineweb_q05/datafusion:vortex-compact 1476309298 1338517460 1.10
fineweb_q06/datafusion:vortex-compact 1391390908 1256070814 1.11
fineweb_q07/datafusion:vortex-compact 1197728346 1163324309 1.03
fineweb_q08/datafusion:vortex-compact 405302933 394375901 1.03
datafusion / parquet (0.957x ➖, 0↑ 0↓)
name PR ff7d356 (ns) base 5abaf98 (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 1384776901 1298338226 1.07
fineweb_q01/datafusion:parquet 1895707503 2054235259 0.92
fineweb_q02/datafusion:parquet 1805079480 2003531703 0.90
fineweb_q03/datafusion:parquet 1955736788 2132329564 0.92
fineweb_q04/datafusion:parquet 2027798279 2012281646 1.01
fineweb_q05/datafusion:parquet 2064423192 2155114625 0.96
fineweb_q06/datafusion:parquet 1855397401 2096340506 0.89
fineweb_q07/datafusion:parquet 1969639151 1956677702 1.01
fineweb_q08/datafusion:parquet 2009233117 2078522952 0.97
duckdb / vortex-file-compressed (0.985x ➖, 0↑ 0↓)
name PR ff7d356 (ns) base 5abaf98 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 104837802 80845856 1.30
fineweb_q01/duckdb:vortex-file-compressed 629844330 764803647 0.82
fineweb_q02/duckdb:vortex-file-compressed 547225397 734330453 0.75
fineweb_q03/duckdb:vortex-file-compressed 1405895921 1389200345 1.01
fineweb_q04/duckdb:vortex-file-compressed 1620661620 1295370370 1.25
fineweb_q05/duckdb:vortex-file-compressed 1365668711 1282912434 1.06
fineweb_q06/duckdb:vortex-file-compressed 1440782798 1522099650 0.95
fineweb_q07/duckdb:vortex-file-compressed 1235569749 1303551897 0.95
fineweb_q08/duckdb:vortex-file-compressed 556128345 614573153 0.90
duckdb / vortex-compact (0.968x ➖, 0↑ 0↓)
name PR ff7d356 (ns) base 5abaf98 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 86314389 83950800 1.03
fineweb_q01/duckdb:vortex-compact 604583591 780236316 0.77
fineweb_q02/duckdb:vortex-compact 595141974 660114149 0.90
fineweb_q03/duckdb:vortex-compact 1644133128 1707842903 0.96
fineweb_q04/duckdb:vortex-compact 1805532336 1778744640 1.02
fineweb_q05/duckdb:vortex-compact 1651274156 1509152651 1.09
fineweb_q06/duckdb:vortex-compact 1511935127 1657076532 0.91
fineweb_q07/duckdb:vortex-compact 1541964844 1378900642 1.12
fineweb_q08/duckdb:vortex-compact 509447561 536919885 0.95
duckdb / parquet (0.914x ➖, 0↑ 0↓)
name PR ff7d356 (ns) base 5abaf98 (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 1157820594 1181581209 0.98
fineweb_q01/duckdb:parquet 1358214909 1664528097 0.82
fineweb_q02/duckdb:parquet 1406335157 1653149022 0.85
fineweb_q03/duckdb:parquet 3927955072 4279473319 0.92
fineweb_q04/duckdb:parquet 2080455283 2196188788 0.95
fineweb_q05/duckdb:parquet 2318182222 2269358791 1.02
fineweb_q06/duckdb:parquet 4474405676 4587459333 0.98
fineweb_q07/duckdb:parquet 2714031281 2979804728 0.91
fineweb_q08/duckdb:parquet 1124585700 1359388421 0.83

@github-actions

github-actions Bot commented Jul 14, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Statistical and Population Genetics

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +1.4%
Engines: DuckDB No clear signal (+1.4%, low confidence)
Vortex (geomean): 1.006x ➖
Parquet (geomean): 0.992x ➖
Shifts: Parquet (control) -0.8% · Median polish +0.2%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
duckdb / vortex-file-compressed (1.000x ➖, 0↑ 0↓)
name PR ff7d356 (ns) base 5abaf98 (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-file-compressed 12104392 12405703 0.98
statpopgen_q01/duckdb:vortex-file-compressed 27031750 27351457 0.99
statpopgen_q02/duckdb:vortex-file-compressed 538680669 517619220 1.04
statpopgen_q03/duckdb:vortex-file-compressed 1046156601 1016214742 1.03
statpopgen_q04/duckdb:vortex-file-compressed 1049802376 1034873475 1.01
statpopgen_q05/duckdb:vortex-file-compressed 454749515 461392095 0.99
statpopgen_q06/duckdb:vortex-file-compressed 1513563393 1509413935 1.00
statpopgen_q07/duckdb:vortex-file-compressed 192636338 199719851 0.96
statpopgen_q08/duckdb:vortex-file-compressed 221105934 226265725 0.98
statpopgen_q09/duckdb:vortex-file-compressed 819054203 809223865 1.01
statpopgen_q10/duckdb:vortex-file-compressed 2539314641 2506591191 1.01
duckdb / vortex-compact (1.011x ➖, 0↑ 0↓)
name PR ff7d356 (ns) base 5abaf98 (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-compact 11610460 11677709 0.99
statpopgen_q01/duckdb:vortex-compact 215349152 214568181 1.00
statpopgen_q02/duckdb:vortex-compact 557810448 557983853 1.00
statpopgen_q03/duckdb:vortex-compact 1143872351 1152247849 0.99
statpopgen_q04/duckdb:vortex-compact 1147526705 1140754287 1.01
statpopgen_q05/duckdb:vortex-compact 582478392 562481900 1.04
statpopgen_q06/duckdb:vortex-compact 1521160928 1469053943 1.04
statpopgen_q07/duckdb:vortex-compact 884777604 861140161 1.03
statpopgen_q08/duckdb:vortex-compact 913236122 891947771 1.02
statpopgen_q09/duckdb:vortex-compact 919346144 923979972 0.99
statpopgen_q10/duckdb:vortex-compact 2598520411 2568296393 1.01
duckdb / parquet (0.992x ➖, 0↑ 0↓)
name PR ff7d356 (ns) base 5abaf98 (ns) ratio (PR/base)
statpopgen_q00/duckdb:parquet 293203460 301695106 0.97
statpopgen_q01/duckdb:parquet 377134745 376474073 1.00
statpopgen_q02/duckdb:parquet 768299103 759776293 1.01
statpopgen_q03/duckdb:parquet 1180910565 1168349140 1.01
statpopgen_q04/duckdb:parquet 1188281222 1202293769 0.99
statpopgen_q05/duckdb:parquet 806438671 807011416 1.00
statpopgen_q06/duckdb:parquet 1417501821 1445988094 0.98
statpopgen_q07/duckdb:parquet 845254029 866021199 0.98
statpopgen_q08/duckdb:parquet 854252358 870343930 0.98
statpopgen_q09/duckdb:parquet 998171901 1006195911 0.99
statpopgen_q10/duckdb:parquet 2196982257 2199236591 1.00
File Size Changes (2 files changed, -0.0% overall, 0↑ 2↓)
File Scale Format Base HEAD Change %
gnomad.genomes.v3.1.2.hgdp_tgp.chr21.vortex 100000 vortex-file-compressed 1.96 GB 1.96 GB 89.43 KB -0.0%
gnomad.genomes.v3.1.2.hgdp_tgp.chr21.vortex 100000 vortex-compact 960.66 MB 959.35 MB 1.31 MB -0.1%

Totals:

  • vortex-compact: 960.92 MB → 959.62 MB (-0.1%)
  • vortex-file-compressed: 1.96 GB → 1.96 GB (-0.0%)

@github-actions

github-actions Bot commented Jul 14, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.5%
Engines: DataFusion No clear signal (+0.4%, low confidence) · DuckDB No clear signal (-1.4%, low confidence)
Vortex (geomean): 0.979x ➖
Parquet (geomean): 0.989x ➖
Shifts: Parquet (control) -1.1% · Median polish -1.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (1.035x ➖, 0↑ 1↓)
name PR ff7d356 (ns) base 5abaf98 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 424337588 422320793 1.00
tpch_q02/datafusion:vortex-file-compressed 101037262 100083826 1.01
tpch_q03/datafusion:vortex-file-compressed 194088623 196322822 0.99
tpch_q04/datafusion:vortex-file-compressed 93921102 96790726 0.97
tpch_q05/datafusion:vortex-file-compressed 330606849 330207529 1.00
tpch_q06/datafusion:vortex-file-compressed 35436585 38695240 0.92
tpch_q07/datafusion:vortex-file-compressed 454460002 447489801 1.02
tpch_q08/datafusion:vortex-file-compressed 333611209 343810738 0.97
tpch_q09/datafusion:vortex-file-compressed 586640322 594986929 0.99
tpch_q10/datafusion:vortex-file-compressed 224717016 219619010 1.02
tpch_q11/datafusion:vortex-file-compressed 78198162 77718537 1.01
tpch_q12/datafusion:vortex-file-compressed 109875495 112803114 0.97
tpch_q13/datafusion:vortex-file-compressed 197572339 195463204 1.01
tpch_q14/datafusion:vortex-file-compressed 47989467 51458512 0.93
tpch_q15/datafusion:vortex-file-compressed 94976020 100372278 0.95
tpch_q16/datafusion:vortex-file-compressed 75142117 74760822 1.01
tpch_q17/datafusion:vortex-file-compressed 569665552 579608593 0.98
tpch_q18/datafusion:vortex-file-compressed 823763695 845489377 0.97
tpch_q19/datafusion:vortex-file-compressed 🚨 223797998 76660517 2.92
tpch_q20/datafusion:vortex-file-compressed 154594059 159812986 0.97
tpch_q21/datafusion:vortex-file-compressed 606610456 603215755 1.01
tpch_q22/datafusion:vortex-file-compressed 55306534 54587078 1.01
datafusion / vortex-compact (0.966x ➖, 5↑ 1↓)
name PR ff7d356 (ns) base 5abaf98 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 🚀 446998409 505197879 0.88
tpch_q02/datafusion:vortex-compact 105637429 105240272 1.00
tpch_q03/datafusion:vortex-compact 200338386 214646910 0.93
tpch_q04/datafusion:vortex-compact 🚀 106701478 128413265 0.83
tpch_q05/datafusion:vortex-compact 341795911 349902149 0.98
tpch_q06/datafusion:vortex-compact 58429148 61891270 0.94
tpch_q07/datafusion:vortex-compact 460000132 483951596 0.95
tpch_q08/datafusion:vortex-compact 340042122 358083353 0.95
tpch_q09/datafusion:vortex-compact 589330770 610224492 0.97
tpch_q10/datafusion:vortex-compact 🚀 239950656 276790213 0.87
tpch_q11/datafusion:vortex-compact 79749064 82337453 0.97
tpch_q12/datafusion:vortex-compact 🚀 151962737 179793265 0.85
tpch_q13/datafusion:vortex-compact 243037792 242950312 1.00
tpch_q14/datafusion:vortex-compact 64600556 67923619 0.95
tpch_q15/datafusion:vortex-compact 149353507 153175454 0.98
tpch_q16/datafusion:vortex-compact 78276049 79741642 0.98
tpch_q17/datafusion:vortex-compact 576876509 584691693 0.99
tpch_q18/datafusion:vortex-compact 836883940 905802613 0.92
tpch_q19/datafusion:vortex-compact 🚨 326538080 209381341 1.56
tpch_q20/datafusion:vortex-compact 179978588 182024237 0.99
tpch_q21/datafusion:vortex-compact 🚀 621993341 693017459 0.90
tpch_q22/datafusion:vortex-compact 65324911 63511506 1.03
datafusion / parquet (0.996x ➖, 0↑ 0↓)
name PR ff7d356 (ns) base 5abaf98 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 476050382 475771149 1.00
tpch_q02/datafusion:parquet 172870989 174956056 0.99
tpch_q03/datafusion:parquet 253968525 260811540 0.97
tpch_q04/datafusion:parquet 119320375 120596270 0.99
tpch_q05/datafusion:parquet 390247839 393117932 0.99
tpch_q06/datafusion:parquet 126227517 132699331 0.95
tpch_q07/datafusion:parquet 559819285 565536099 0.99
tpch_q08/datafusion:parquet 452595169 455044383 0.99
tpch_q09/datafusion:parquet 722015635 725759636 0.99
tpch_q10/datafusion:parquet 578106416 569194817 1.02
tpch_q11/datafusion:parquet 120545689 119371426 1.01
tpch_q12/datafusion:parquet 211640846 208220451 1.02
tpch_q13/datafusion:parquet 344173464 350255643 0.98
tpch_q14/datafusion:parquet 152428443 153969497 0.99
tpch_q15/datafusion:parquet 259339822 254943102 1.02
tpch_q16/datafusion:parquet 120017982 119723706 1.00
tpch_q17/datafusion:parquet 663014266 662630021 1.00
tpch_q18/datafusion:parquet 857951198 866190007 0.99
tpch_q19/datafusion:parquet 276527320 274954384 1.01
tpch_q20/datafusion:parquet 295056491 296401352 1.00
tpch_q21/datafusion:parquet 651870699 649818879 1.00
tpch_q22/datafusion:parquet 208932675 208639692 1.00
datafusion / arrow (0.999x ➖, 0↑ 0↓)
name PR ff7d356 (ns) base 5abaf98 (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 681488405 689701204 0.99
tpch_q02/datafusion:arrow 110777507 111911208 0.99
tpch_q03/datafusion:arrow 497258271 500077980 0.99
tpch_q04/datafusion:arrow 359866898 363448462 0.99
tpch_q05/datafusion:arrow 735650391 743961814 0.99
tpch_q06/datafusion:arrow 327290161 327416475 1.00
tpch_q07/datafusion:arrow 1118138095 1109671561 1.01
tpch_q08/datafusion:arrow 922540928 926628014 1.00
tpch_q09/datafusion:arrow 1075476067 1082743470 0.99
tpch_q10/datafusion:arrow 624299192 635512002 0.98
tpch_q11/datafusion:arrow 91890074 92651536 0.99
tpch_q12/datafusion:arrow 1405813156 1379697982 1.02
tpch_q13/datafusion:arrow 470659291 475287235 0.99
tpch_q14/datafusion:arrow 361756760 356989705 1.01
tpch_q15/datafusion:arrow 726835033 725825098 1.00
tpch_q16/datafusion:arrow 81147282 80556360 1.01
tpch_q17/datafusion:arrow 961845687 969143860 0.99
tpch_q18/datafusion:arrow 1811331113 1828588621 0.99
tpch_q19/datafusion:arrow 549854826 537651738 1.02
tpch_q20/datafusion:arrow 499011651 494174833 1.01
tpch_q21/datafusion:arrow 3072793626 3103164991 0.99
tpch_q22/datafusion:arrow 80983855 80201092 1.01
duckdb / vortex-file-compressed (1.011x ➖, 0↑ 0↓)
name PR ff7d356 (ns) base 5abaf98 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 170265951 169038533 1.01
tpch_q02/duckdb:vortex-file-compressed 55113502 52858137 1.04
tpch_q03/duckdb:vortex-file-compressed 122601564 120008094 1.02
tpch_q04/duckdb:vortex-file-compressed 157501801 153600331 1.03
tpch_q05/duckdb:vortex-file-compressed 137680522 137694457 1.00
tpch_q06/duckdb:vortex-file-compressed 31977036 34467065 0.93
tpch_q07/duckdb:vortex-file-compressed 136628958 130537931 1.05
tpch_q08/duckdb:vortex-file-compressed 175729088 172535245 1.02
tpch_q09/duckdb:vortex-file-compressed 399839981 395542904 1.01
tpch_q10/duckdb:vortex-file-compressed 195593394 195189580 1.00
tpch_q11/duckdb:vortex-file-compressed 32985138 31009875 1.06
tpch_q12/duckdb:vortex-file-compressed 105425540 105321157 1.00
tpch_q13/duckdb:vortex-file-compressed 271002633 274266802 0.99
tpch_q14/duckdb:vortex-file-compressed 52790545 53577981 0.99
tpch_q15/duckdb:vortex-file-compressed 88850676 89492127 0.99
tpch_q16/duckdb:vortex-file-compressed 77257813 77090312 1.00
tpch_q17/duckdb:vortex-file-compressed 92429155 88953988 1.04
tpch_q18/duckdb:vortex-file-compressed 289849175 290773909 1.00
tpch_q19/duckdb:vortex-file-compressed 78684106 74634429 1.05
tpch_q20/duckdb:vortex-file-compressed 142619898 144045739 0.99
tpch_q21/duckdb:vortex-file-compressed 491350509 485069384 1.01
tpch_q22/duckdb:vortex-file-compressed 64555847 63638352 1.01
duckdb / vortex-compact (0.910x ➖, 9↑ 0↓)
name PR ff7d356 (ns) base 5abaf98 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 🚀 227935732 274321539 0.83
tpch_q02/duckdb:vortex-compact 60619906 63232646 0.96
tpch_q03/duckdb:vortex-compact 🚀 135511065 164468298 0.82
tpch_q04/duckdb:vortex-compact 🚀 169688479 226713600 0.75
tpch_q05/duckdb:vortex-compact 🚀 163655213 183056509 0.89
tpch_q06/duckdb:vortex-compact 54467011 58516875 0.93
tpch_q07/duckdb:vortex-compact 🚀 172671387 215124201 0.80
tpch_q08/duckdb:vortex-compact 196179786 217032696 0.90
tpch_q09/duckdb:vortex-compact 425752976 464332045 0.92
tpch_q10/duckdb:vortex-compact 🚀 220895146 261993199 0.84
tpch_q11/duckdb:vortex-compact 37751323 38419095 0.98
tpch_q12/duckdb:vortex-compact 🚀 163996101 194331314 0.84
tpch_q13/duckdb:vortex-compact 323820995 320319046 1.01
tpch_q14/duckdb:vortex-compact 72518691 73379032 0.99
tpch_q15/duckdb:vortex-compact 112651738 118457225 0.95
tpch_q16/duckdb:vortex-compact 81550994 79223662 1.03
tpch_q17/duckdb:vortex-compact 106197035 105165773 1.01
tpch_q18/duckdb:vortex-compact 🚀 291835855 351715105 0.83
tpch_q19/duckdb:vortex-compact 95811580 93605717 1.02
tpch_q20/duckdb:vortex-compact 175479318 184221115 0.95
tpch_q21/duckdb:vortex-compact 🚀 526103515 636554724 0.83
tpch_q22/duckdb:vortex-compact 70889080 71594407 0.99
duckdb / parquet (0.981x ➖, 1↑ 0↓)
name PR ff7d356 (ns) base 5abaf98 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 260247100 270289543 0.96
tpch_q02/duckdb:parquet 104223952 104218979 1.00
tpch_q03/duckdb:parquet 207711520 215498770 0.96
tpch_q04/duckdb:parquet 132602030 141366695 0.94
tpch_q05/duckdb:parquet 227602242 226901306 1.00
tpch_q06/duckdb:parquet 74607520 75655604 0.99
tpch_q07/duckdb:parquet 184570707 190639848 0.97
tpch_q08/duckdb:parquet 264308139 266505854 0.99
tpch_q09/duckdb:parquet 477533714 508510983 0.94
tpch_q10/duckdb:parquet 622582835 630620043 0.99
tpch_q11/duckdb:parquet 64419873 64316402 1.00
tpch_q12/duckdb:parquet 131041424 134197030 0.98
tpch_q13/duckdb:parquet 🚀 403043381 457709666 0.88
tpch_q14/duckdb:parquet 178587678 181669458 0.98
tpch_q15/duckdb:parquet 104071550 104300444 1.00
tpch_q16/duckdb:parquet 166319860 166402430 1.00
tpch_q17/duckdb:parquet 182894432 181121204 1.01
tpch_q18/duckdb:parquet 364395381 364206380 1.00
tpch_q19/duckdb:parquet 283172679 289759264 0.98
tpch_q20/duckdb:parquet 232924145 224180416 1.04
tpch_q21/duckdb:parquet 563808252 561537670 1.00
tpch_q22/duckdb:parquet 293842008 295602099 0.99
duckdb / duckdb (0.984x ➖, 0↑ 0↓)
name PR ff7d356 (ns) base 5abaf98 (ns) ratio (PR/base)
tpch_q01/duckdb:duckdb 120147907 121233065 0.99
tpch_q02/duckdb:duckdb 49482685 51545881 0.96
tpch_q03/duckdb:duckdb 103745939 103838776 1.00
tpch_q04/duckdb:duckdb 137316579 139663377 0.98
tpch_q05/duckdb:duckdb 118879727 119526431 0.99
tpch_q06/duckdb:duckdb 45306178 44708224 1.01
tpch_q07/duckdb:duckdb 92011447 92108385 1.00
tpch_q08/duckdb:duckdb 117653405 119252544 0.99
tpch_q09/duckdb:duckdb 280387007 282866583 0.99
tpch_q10/duckdb:duckdb 208656587 215583059 0.97
tpch_q11/duckdb:duckdb 19294274 19369594 1.00
tpch_q12/duckdb:duckdb 89739470 91156723 0.98
tpch_q13/duckdb:duckdb 231357908 238284454 0.97
tpch_q14/duckdb:duckdb 77683441 80106042 0.97
tpch_q15/duckdb:duckdb 80909374 82913732 0.98
tpch_q16/duckdb:duckdb 75252834 77713135 0.97
tpch_q17/duckdb:duckdb 87494508 88518470 0.99
tpch_q18/duckdb:duckdb 233884025 237217499 0.99
tpch_q19/duckdb:duckdb 124117808 124830136 0.99
tpch_q20/duckdb:duckdb 117984589 119222771 0.99
tpch_q21/duckdb:duckdb 295576362 305808858 0.97
tpch_q22/duckdb:duckdb 68041906 69239196 0.98
File Size Changes (48 files changed, -0.0% overall, 27↑ 21↓)
File Scale Format Base HEAD Change %
nation_0.vortex 10.0 vortex-compact 7.80 KB 8.38 KB +588 B +7.4%
nation_0.vortex 10.0 vortex-file-compressed 10.84 KB 11.03 KB +196 B +1.8%
region_0.vortex 10.0 vortex-compact 5.83 KB 5.89 KB +60 B +1.0%
part_1.vortex 10.0 vortex-compact 16.83 MB 16.92 MB +84.79 KB +0.5%
part_1.vortex 10.0 vortex-file-compressed 24.72 MB 24.80 MB +90.50 KB +0.4%
lineitem_8.vortex 10.0 vortex-file-compressed 129.15 MB 129.41 MB +266.85 KB +0.2%
partsupp_1.vortex 10.0 vortex-compact 104.79 MB 104.95 MB +161.82 KB +0.2%
part_0.vortex 10.0 vortex-file-compressed 24.73 MB 24.77 MB +38.05 KB +0.2%
orders_0.vortex 10.0 vortex-file-compressed 133.16 MB 133.33 MB +170.81 KB +0.1%
lineitem_4.vortex 10.0 vortex-file-compressed 129.30 MB 129.45 MB +152.23 KB +0.1%
lineitem_0.vortex 10.0 vortex-file-compressed 129.27 MB 129.39 MB +127.57 KB +0.1%
orders_2.vortex 10.0 vortex-file-compressed 134.58 MB 134.68 MB +104.00 KB +0.1%
lineitem_2.vortex 10.0 vortex-file-compressed 129.38 MB 129.47 MB +91.29 KB +0.1%
orders_1.vortex 10.0 vortex-file-compressed 134.58 MB 134.67 MB +90.82 KB +0.1%
lineitem_3.vortex 10.0 vortex-file-compressed 129.42 MB 129.46 MB +46.56 KB +0.0%
lineitem_12.vortex 10.0 vortex-file-compressed 129.36 MB 129.39 MB +30.35 KB +0.0%
supplier_0.vortex 10.0 vortex-compact 4.73 MB 4.73 MB +292 B +0.0%
lineitem_8.vortex 10.0 vortex-compact 100.59 MB 100.59 MB +2.03 KB +0.0%
lineitem_9.vortex 10.0 vortex-compact 100.46 MB 100.47 MB +2.02 KB +0.0%
lineitem_1.vortex 10.0 vortex-compact 100.64 MB 100.65 MB +2.00 KB +0.0%
lineitem_5.vortex 10.0 vortex-compact 100.70 MB 100.70 MB +2.00 KB +0.0%
lineitem_4.vortex 10.0 vortex-compact 100.55 MB 100.56 MB +1.98 KB +0.0%
lineitem_0.vortex 10.0 vortex-compact 100.59 MB 100.59 MB +1.98 KB +0.0%
lineitem_12.vortex 10.0 vortex-compact 100.62 MB 100.62 MB +1.98 KB +0.0%
orders_2.vortex 10.0 vortex-compact 114.78 MB 114.78 MB +764 B +0.0%
orders_1.vortex 10.0 vortex-compact 114.76 MB 114.76 MB +740 B +0.0%
orders_0.vortex 10.0 vortex-compact 114.79 MB 114.79 MB +740 B +0.0%
partsupp_0.vortex 10.0 vortex-file-compressed 119.79 MB 119.77 MB 18.33 KB -0.0%
lineitem_5.vortex 10.0 vortex-file-compressed 129.66 MB 129.64 MB 26.54 KB -0.0%
lineitem_11.vortex 10.0 vortex-file-compressed 129.23 MB 129.19 MB 33.22 KB -0.0%
lineitem_10.vortex 10.0 vortex-file-compressed 129.50 MB 129.46 MB 38.15 KB -0.0%
customer_0.vortex 10.0 vortex-compact 74.09 MB 74.07 MB 23.31 KB -0.0%
lineitem_7.vortex 10.0 vortex-file-compressed 129.43 MB 129.39 MB 42.84 KB -0.0%
lineitem_6.vortex 10.0 vortex-file-compressed 129.56 MB 129.51 MB 44.59 KB -0.0%
supplier_0.vortex 10.0 vortex-file-compressed 5.71 MB 5.71 MB 2.20 KB -0.0%
customer_0.vortex 10.0 vortex-file-compressed 88.54 MB 88.50 MB 36.14 KB -0.0%
partsupp_1.vortex 10.0 vortex-file-compressed 119.74 MB 119.68 MB 65.70 KB -0.1%
lineitem_9.vortex 10.0 vortex-file-compressed 129.23 MB 129.13 MB 108.21 KB -0.1%
lineitem_1.vortex 10.0 vortex-file-compressed 129.51 MB 129.28 MB 230.47 KB -0.2%
lineitem_6.vortex 10.0 vortex-compact 100.88 MB 100.68 MB 198.94 KB -0.2%
lineitem_2.vortex 10.0 vortex-compact 100.79 MB 100.59 MB 205.51 KB -0.2%
lineitem_10.vortex 10.0 vortex-compact 100.83 MB 100.62 MB 209.96 KB -0.2%
lineitem_7.vortex 10.0 vortex-compact 100.79 MB 100.58 MB 216.58 KB -0.2%
lineitem_11.vortex 10.0 vortex-compact 100.75 MB 100.53 MB 229.11 KB -0.2%
lineitem_3.vortex 10.0 vortex-compact 100.85 MB 100.62 MB 233.07 KB -0.2%
partsupp_0.vortex 10.0 vortex-compact 105.14 MB 104.76 MB 390.21 KB -0.4%
part_0.vortex 10.0 vortex-compact 17.04 MB 16.92 MB 120.58 KB -0.7%
region_0.vortex 10.0 vortex-file-compressed 6.65 KB 6.19 KB 468 B -6.9%

Totals:

  • vortex-compact: 1.93 GB → 1.93 GB (-0.1%)
  • vortex-file-compressed: 2.41 GB → 2.41 GB (+0.0%)

@github-actions

github-actions Bot commented Jul 14, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.3%
Engines: DataFusion No clear signal (+3.3%, environment too noisy confidence) · DuckDB No clear signal (-2.9%, low confidence)
Vortex (geomean): 0.968x ➖
Parquet (geomean): 0.976x ➖
Shifts: Parquet (control) -2.4% · Median polish -3.0%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (0.992x ➖, 5↑ 9↓)
name PR ff7d356 (ns) base 5abaf98 (ns) ratio (PR/base)
clickbench_q00/datafusion:vortex-file-compressed 1599027 1681839 0.95
clickbench_q01/datafusion:vortex-file-compressed 🚀 16025488 19189159 0.84
clickbench_q02/datafusion:vortex-file-compressed 36211018 36601273 0.99
clickbench_q03/datafusion:vortex-file-compressed 40344380 40985449 0.98
clickbench_q04/datafusion:vortex-file-compressed 243918120 254603655 0.96
clickbench_q05/datafusion:vortex-file-compressed 311659514 324002627 0.96
clickbench_q06/datafusion:vortex-file-compressed 1718761 1668989 1.03
clickbench_q07/datafusion:vortex-file-compressed 🚀 20552618 23928150 0.86
clickbench_q08/datafusion:vortex-file-compressed 351511203 352205743 1.00
clickbench_q09/datafusion:vortex-file-compressed 🚨 543063630 473017271 1.15
clickbench_q10/datafusion:vortex-file-compressed 84798108 79754466 1.06
clickbench_q11/datafusion:vortex-file-compressed 🚨 101716133 90018577 1.13
clickbench_q12/datafusion:vortex-file-compressed 🚨 339678814 286246458 1.19
clickbench_q13/datafusion:vortex-file-compressed 🚨 557550250 462366984 1.21
clickbench_q14/datafusion:vortex-file-compressed 🚨 346511135 275403681 1.26
clickbench_q15/datafusion:vortex-file-compressed 🚨 360382949 296508341 1.22
clickbench_q16/datafusion:vortex-file-compressed 686187657 691993349 0.99
clickbench_q17/datafusion:vortex-file-compressed 672903160 703338013 0.96
clickbench_q18/datafusion:vortex-file-compressed 1476073885 1431595163 1.03
clickbench_q19/datafusion:vortex-file-compressed 🚨 34223194 28120694 1.22
clickbench_q20/datafusion:vortex-file-compressed 🚨 395212561 334105791 1.18
clickbench_q21/datafusion:vortex-file-compressed 🚨 494110853 415480207 1.19
clickbench_q22/datafusion:vortex-file-compressed 535527571 534435369 1.00
clickbench_q23/datafusion:vortex-file-compressed 685615804 654514924 1.05
clickbench_q24/datafusion:vortex-file-compressed 42361920 47052968 0.90
clickbench_q25/datafusion:vortex-file-compressed 🚀 70015159 82868381 0.84
clickbench_q26/datafusion:vortex-file-compressed 44084594 48246336 0.91
clickbench_q27/datafusion:vortex-file-compressed 414071516 438158770 0.95
clickbench_q28/datafusion:vortex-file-compressed 2361815252 2511198753 0.94
clickbench_q29/datafusion:vortex-file-compressed 🚀 50066116 56647067 0.88
clickbench_q30/datafusion:vortex-file-compressed 🚀 221678082 247060347 0.90
clickbench_q31/datafusion:vortex-file-compressed 238546853 263270156 0.91
clickbench_q32/datafusion:vortex-file-compressed 1050035831 1132985478 0.93
clickbench_q33/datafusion:vortex-file-compressed 1392469545 1541251398 0.90
clickbench_q34/datafusion:vortex-file-compressed 1413602605 1518375934 0.93
clickbench_q35/datafusion:vortex-file-compressed 228827728 253398835 0.90
clickbench_q36/datafusion:vortex-file-compressed 53209931 58792586 0.91
clickbench_q37/datafusion:vortex-file-compressed 24813257 26367166 0.94
clickbench_q38/datafusion:vortex-file-compressed 16337009 16563165 0.99
clickbench_q39/datafusion:vortex-file-compressed 118924304 129277125 0.92
clickbench_q40/datafusion:vortex-file-compressed 12187206 12507898 0.97
clickbench_q41/datafusion:vortex-file-compressed 12148823 12763357 0.95
clickbench_q42/datafusion:vortex-file-compressed 11526957 12239817 0.94
datafusion / parquet (0.960x ➖, 4↑ 2↓)
name PR ff7d356 (ns) base 5abaf98 (ns) ratio (PR/base)
clickbench_q00/datafusion:parquet 🚀 1745475 2589234 0.67
clickbench_q01/datafusion:parquet 20687871 20046611 1.03
clickbench_q02/datafusion:parquet 47832034 47092999 1.02
clickbench_q03/datafusion:parquet 39585012 37770101 1.05
clickbench_q04/datafusion:parquet 🚨 321078432 272941516 1.18
clickbench_q05/datafusion:parquet 🚨 380319875 333519194 1.14
clickbench_q06/datafusion:parquet 1626924 1538240 1.06
clickbench_q07/datafusion:parquet 22720421 21577428 1.05
clickbench_q08/datafusion:parquet 339958548 348381026 0.98
clickbench_q09/datafusion:parquet 466925220 501909170 0.93
clickbench_q10/datafusion:parquet 91848585 96952926 0.95
clickbench_q11/datafusion:parquet 115441600 119797494 0.96
clickbench_q12/datafusion:parquet 308165936 326192108 0.94
clickbench_q13/datafusion:parquet 458880257 506788291 0.91
clickbench_q14/datafusion:parquet 313477251 342805702 0.91
clickbench_q15/datafusion:parquet 276127806 294406703 0.94
clickbench_q16/datafusion:parquet 642699404 706743600 0.91
clickbench_q17/datafusion:parquet 644772303 695358058 0.93
clickbench_q18/datafusion:parquet 🚀 1364834064 1599120640 0.85
clickbench_q19/datafusion:parquet 26552107 27180670 0.98
clickbench_q20/datafusion:parquet 561592521 586888486 0.96
clickbench_q21/datafusion:parquet 616171165 645330451 0.95
clickbench_q22/datafusion:parquet 919235194 955992943 0.96
clickbench_q23/datafusion:parquet 4452378749 4368267957 1.02
clickbench_q24/datafusion:parquet 54065381 54106494 1.00
clickbench_q25/datafusion:parquet 127085999 130429353 0.97
clickbench_q26/datafusion:parquet 53571102 55047691 0.97
clickbench_q27/datafusion:parquet 651696923 694785664 0.94
clickbench_q28/datafusion:parquet 2415955217 2550446949 0.95
clickbench_q29/datafusion:parquet 🚀 44649610 56513994 0.79
clickbench_q30/datafusion:parquet 310835960 328117006 0.95
clickbench_q31/datafusion:parquet 🚀 338660227 376869796 0.90
clickbench_q32/datafusion:parquet 1082716343 1146044636 0.94
clickbench_q33/datafusion:parquet 1492357001 1592772820 0.94
clickbench_q34/datafusion:parquet 1478568384 1581953093 0.93
clickbench_q35/datafusion:parquet 254009499 264520854 0.96
clickbench_q36/datafusion:parquet 109242745 110587701 0.99
clickbench_q37/datafusion:parquet 45232550 43490933 1.04
clickbench_q38/datafusion:parquet 60946177 62391517 0.98
clickbench_q39/datafusion:parquet 210474965 217983531 0.97
clickbench_q40/datafusion:parquet 23707189 25332446 0.94
clickbench_q41/datafusion:parquet 21946143 21783837 1.01
clickbench_q42/datafusion:parquet 22688737 22571734 1.01
duckdb / vortex-file-compressed (0.945x ➖, 11↑ 4↓)
name PR ff7d356 (ns) base 5abaf98 (ns) ratio (PR/base)
clickbench_q00/duckdb:vortex-file-compressed 🚀 7591197 9960120 0.76
clickbench_q01/duckdb:vortex-file-compressed 🚀 11404128 16783641 0.68
clickbench_q02/duckdb:vortex-file-compressed 🚨 26620577 22215338 1.20
clickbench_q03/duckdb:vortex-file-compressed 29817782 28155088 1.06
clickbench_q04/duckdb:vortex-file-compressed 🚀 186461722 209859521 0.89
clickbench_q05/duckdb:vortex-file-compressed 🚀 177626908 197850844 0.90
clickbench_q06/duckdb:vortex-file-compressed 19923557 19414474 1.03
clickbench_q07/duckdb:vortex-file-compressed 🚀 14779843 20558899 0.72
clickbench_q08/duckdb:vortex-file-compressed 263032612 281382896 0.93
clickbench_q09/duckdb:vortex-file-compressed 342937130 365707827 0.94
clickbench_q10/duckdb:vortex-file-compressed 70630393 76082984 0.93
clickbench_q11/duckdb:vortex-file-compressed 82334563 86905870 0.95
clickbench_q12/duckdb:vortex-file-compressed 204764622 225982827 0.91
clickbench_q13/duckdb:vortex-file-compressed 414832496 441989641 0.94
clickbench_q14/duckdb:vortex-file-compressed 276563021 265309490 1.04
clickbench_q15/duckdb:vortex-file-compressed 284736260 263239959 1.08
clickbench_q16/duckdb:vortex-file-compressed 🚨 654404768 573238178 1.14
clickbench_q17/duckdb:vortex-file-compressed 🚨 523667258 467546360 1.12
clickbench_q18/duckdb:vortex-file-compressed 959592894 999152510 0.96
clickbench_q19/duckdb:vortex-file-compressed 20647276 21943371 0.94
clickbench_q20/duckdb:vortex-file-compressed 🚀 290471662 331645389 0.88
clickbench_q21/duckdb:vortex-file-compressed 394559626 408832559 0.97
clickbench_q22/duckdb:vortex-file-compressed 539771219 567778078 0.95
clickbench_q23/duckdb:vortex-file-compressed 🚀 167931711 191743885 0.88
clickbench_q24/duckdb:vortex-file-compressed 37789980 37275536 1.01
clickbench_q25/duckdb:vortex-file-compressed 79323308 84763963 0.94
clickbench_q26/duckdb:vortex-file-compressed 48877521 47229390 1.03
clickbench_q27/duckdb:vortex-file-compressed 213038311 223993860 0.95
clickbench_q28/duckdb:vortex-file-compressed 3003774184 3165856822 0.95
clickbench_q29/duckdb:vortex-file-compressed 28584824 26640692 1.07
clickbench_q30/duckdb:vortex-file-compressed 194961180 209116805 0.93
clickbench_q31/duckdb:vortex-file-compressed 290368404 309446155 0.94
clickbench_q32/duckdb:vortex-file-compressed 1127891291 1195847165 0.94
clickbench_q33/duckdb:vortex-file-compressed 1140579866 1221031738 0.93
clickbench_q34/duckdb:vortex-file-compressed 🚨 1513923119 1321130468 1.15
clickbench_q35/duckdb:vortex-file-compressed 400259222 380328751 1.05
clickbench_q36/duckdb:vortex-file-compressed 🚀 28135414 34106899 0.82
clickbench_q37/duckdb:vortex-file-compressed 🚀 20059294 22306218 0.90
clickbench_q38/duckdb:vortex-file-compressed 23581235 26178634 0.90
clickbench_q39/duckdb:vortex-file-compressed 45606414 48973803 0.93
clickbench_q40/duckdb:vortex-file-compressed 🚀 19534529 22672261 0.86
clickbench_q41/duckdb:vortex-file-compressed 19729190 21815634 0.90
clickbench_q42/duckdb:vortex-file-compressed 🚀 19651616 22655250 0.87
duckdb / parquet (0.993x ➖, 0↑ 3↓)
name PR ff7d356 (ns) base 5abaf98 (ns) ratio (PR/base)
clickbench_q00/duckdb:parquet 23428795 23670865 0.99
clickbench_q01/duckdb:parquet 28480535 30909221 0.92
clickbench_q02/duckdb:parquet 50088537 50933287 0.98
clickbench_q03/duckdb:parquet 39543695 40737746 0.97
clickbench_q04/duckdb:parquet 202873486 211825513 0.96
clickbench_q05/duckdb:parquet 256473094 269063306 0.95
clickbench_q06/duckdb:parquet 47440197 48878740 0.97
clickbench_q07/duckdb:parquet 31571824 31883438 0.99
clickbench_q08/duckdb:parquet 270066673 279409115 0.97
clickbench_q09/duckdb:parquet 399501233 412710714 0.97
clickbench_q10/duckdb:parquet 81953249 83619209 0.98
clickbench_q11/duckdb:parquet 99985359 101735771 0.98
clickbench_q12/duckdb:parquet 279510989 290501707 0.96
clickbench_q13/duckdb:parquet 469986603 493070633 0.95
clickbench_q14/duckdb:parquet 314653715 326008445 0.97
clickbench_q15/duckdb:parquet 257120615 264484557 0.97
clickbench_q16/duckdb:parquet 595316309 621909676 0.96
clickbench_q17/duckdb:parquet 499653384 516968255 0.97
clickbench_q18/duckdb:parquet 1048472469 1083999892 0.97
clickbench_q19/duckdb:parquet 30429174 28956383 1.05
clickbench_q20/duckdb:parquet 472008549 437962763 1.08
clickbench_q21/duckdb:parquet 🚨 611675663 545373103 1.12
clickbench_q22/duckdb:parquet 🚨 1034449226 935464863 1.11
clickbench_q23/duckdb:parquet 265651686 278839406 0.95
clickbench_q24/duckdb:parquet 73908654 72492547 1.02
clickbench_q25/duckdb:parquet 162975138 164377498 0.99
clickbench_q26/duckdb:parquet 54750367 54042913 1.01
clickbench_q27/duckdb:parquet 477258186 484006190 0.99
clickbench_q28/duckdb:parquet 4812176376 4874598757 0.99
clickbench_q29/duckdb:parquet 42630043 42771723 1.00
clickbench_q30/duckdb:parquet 315193725 318983550 0.99
clickbench_q31/duckdb:parquet 376456882 389853361 0.97
clickbench_q32/duckdb:parquet 1121816061 1169943682 0.96
clickbench_q33/duckdb:parquet 🚨 1330877417 1173446049 1.13
clickbench_q34/duckdb:parquet 1203643226 1221204055 0.99
clickbench_q35/duckdb:parquet 370887346 375308584 0.99
clickbench_q36/duckdb:parquet 46473702 44946170 1.03
clickbench_q37/duckdb:parquet 33808996 34145213 0.99
clickbench_q38/duckdb:parquet 34510825 35630388 0.97
clickbench_q39/duckdb:parquet 79823065 79203803 1.01
clickbench_q40/duckdb:parquet 20390592 20229200 1.01
clickbench_q41/duckdb:parquet 21131743 20920801 1.01
clickbench_q42/duckdb:parquet 22674864 22589906 1.00
duckdb / duckdb (0.984x ➖, 0↑ 1↓)
name PR ff7d356 (ns) base 5abaf98 (ns) ratio (PR/base)
clickbench_q00/duckdb:duckdb 17096961 17331569 0.99
clickbench_q01/duckdb:duckdb 34270947 34457462 0.99
clickbench_q02/duckdb:duckdb 51094500 52365170 0.98
clickbench_q03/duckdb:duckdb 55820206 56367859 0.99
clickbench_q04/duckdb:duckdb 213049210 218784920 0.97
clickbench_q05/duckdb:duckdb 282644750 290761625 0.97
clickbench_q06/duckdb:duckdb 34340189 35028576 0.98
clickbench_q07/duckdb:duckdb 34801771 35622105 0.98
clickbench_q08/duckdb:duckdb 278466739 277458613 1.00
clickbench_q09/duckdb:duckdb 397907294 405329485 0.98
clickbench_q10/duckdb:duckdb 118821845 118037141 1.01
clickbench_q11/duckdb:duckdb 125424588 129504318 0.97
clickbench_q12/duckdb:duckdb 261989318 263519478 0.99
clickbench_q13/duckdb:duckdb 445256727 471158899 0.95
clickbench_q14/duckdb:duckdb 282764528 294936823 0.96
clickbench_q15/duckdb:duckdb 239225878 244532197 0.98
clickbench_q16/duckdb:duckdb 584373862 584919577 1.00
clickbench_q17/duckdb:duckdb 🚨 549736914 482418883 1.14
clickbench_q18/duckdb:duckdb 1065253411 1051322702 1.01
clickbench_q19/duckdb:duckdb 35424410 35417215 1.00
clickbench_q20/duckdb:duckdb 485345053 486826232 1.00
clickbench_q21/duckdb:duckdb 491653148 491808821 1.00
clickbench_q22/duckdb:duckdb 539562500 572255860 0.94
clickbench_q23/duckdb:duckdb 247570231 259980061 0.95
clickbench_q24/duckdb:duckdb 60777029 62471764 0.97
clickbench_q25/duckdb:duckdb 148601081 151624912 0.98
clickbench_q26/duckdb:duckdb 61252349 63780624 0.96
clickbench_q27/duckdb:duckdb 415166057 432816356 0.96
clickbench_q28/duckdb:duckdb 4406010012 4509907607 0.98
clickbench_q29/duckdb:duckdb 49953554 50636412 0.99
clickbench_q30/duckdb:duckdb 278403733 284304580 0.98
clickbench_q31/duckdb:duckdb 361368955 379363624 0.95
clickbench_q32/duckdb:duckdb 1109678001 1155010753 0.96
clickbench_q33/duckdb:duckdb 1114878418 1188100158 0.94
clickbench_q34/duckdb:duckdb 1192848704 1284670528 0.93
clickbench_q35/duckdb:duckdb 295595770 308116310 0.96
clickbench_q36/duckdb:duckdb 54691859 49767545 1.10
clickbench_q37/duckdb:duckdb 28092529 29268045 0.96
clickbench_q38/duckdb:duckdb 32825561 33467584 0.98
clickbench_q39/duckdb:duckdb 84051904 80836349 1.04
clickbench_q40/duckdb:duckdb 27743372 28524597 0.97
clickbench_q41/duckdb:duckdb 26927384 27319080 0.99
clickbench_q42/duckdb:duckdb 30567294 29709406 1.03
File Size Changes (201 files changed, -0.4% overall, 64↑ 137↓)
File Scale Format Base HEAD Change %
hits_55.vortex 1.0 vortex-compact 92.56 MB 96.04 MB +3.48 MB +3.8%
hits_90.vortex 1.0 vortex-compact 82.09 MB 82.52 MB +439.25 KB +0.5%
hits_97.vortex 1.0 vortex-file-compressed 106.65 MB 107.03 MB +384.60 KB +0.4%
hits_29.vortex 1.0 vortex-file-compressed 59.35 MB 59.50 MB +153.46 KB +0.3%
hits_65.vortex 1.0 vortex-compact 129.40 MB 129.71 MB +314.50 KB +0.2%
hits_2.vortex 1.0 vortex-file-compressed 186.08 MB 186.44 MB +369.38 KB +0.2%
hits_79.vortex 1.0 vortex-file-compressed 143.75 MB 144.01 MB +268.97 KB +0.2%
hits_67.vortex 1.0 vortex-file-compressed 183.83 MB 184.12 MB +300.01 KB +0.2%
hits_37.vortex 1.0 vortex-file-compressed 85.35 MB 85.47 MB +128.22 KB +0.1%
hits_27.vortex 1.0 vortex-compact 69.86 MB 69.95 MB +92.58 KB +0.1%
hits_12.vortex 1.0 vortex-file-compressed 100.77 MB 100.89 MB +130.55 KB +0.1%
hits_50.vortex 1.0 vortex-file-compressed 179.00 MB 179.23 MB +230.66 KB +0.1%
hits_35.vortex 1.0 vortex-file-compressed 114.90 MB 115.04 MB +146.52 KB +0.1%
hits_75.vortex 1.0 vortex-file-compressed 63.16 MB 63.24 MB +77.65 KB +0.1%
hits_23.vortex 1.0 vortex-file-compressed 76.42 MB 76.50 MB +86.34 KB +0.1%
hits_45.vortex 1.0 vortex-compact 75.80 MB 75.88 MB +83.91 KB +0.1%
hits_20.vortex 1.0 vortex-file-compressed 62.48 MB 62.54 MB +65.96 KB +0.1%
hits_59.vortex 1.0 vortex-file-compressed 101.66 MB 101.77 MB +106.38 KB +0.1%
hits_33.vortex 1.0 vortex-file-compressed 57.02 MB 57.08 MB +58.70 KB +0.1%
hits_96.vortex 1.0 vortex-file-compressed 135.17 MB 135.29 MB +131.67 KB +0.1%
hits_42.vortex 1.0 vortex-file-compressed 221.76 MB 221.95 MB +194.70 KB +0.1%
hits_72.vortex 1.0 vortex-file-compressed 84.39 MB 84.46 MB +71.83 KB +0.1%
hits_62.vortex 1.0 vortex-file-compressed 117.42 MB 117.51 MB +93.97 KB +0.1%
hits_70.vortex 1.0 vortex-file-compressed 93.43 MB 93.50 MB +71.02 KB +0.1%
hits_14.vortex 1.0 vortex-file-compressed 111.10 MB 111.18 MB +81.66 KB +0.1%
hits_19.vortex 1.0 vortex-file-compressed 73.18 MB 73.23 MB +51.66 KB +0.1%
hits_87.vortex 1.0 vortex-file-compressed 172.15 MB 172.25 MB +106.38 KB +0.1%
hits_63.vortex 1.0 vortex-file-compressed 69.06 MB 69.09 MB +37.88 KB +0.1%
hits_38.vortex 1.0 vortex-file-compressed 99.04 MB 99.09 MB +53.39 KB +0.1%
hits_15.vortex 1.0 vortex-file-compressed 89.08 MB 89.12 MB +47.61 KB +0.1%
hits_44.vortex 1.0 vortex-file-compressed 185.68 MB 185.77 MB +94.59 KB +0.0%
hits_85.vortex 1.0 vortex-file-compressed 91.46 MB 91.50 MB +40.80 KB +0.0%
hits_3.vortex 1.0 vortex-file-compressed 141.68 MB 141.74 MB +61.21 KB +0.0%
hits_83.vortex 1.0 vortex-file-compressed 89.15 MB 89.19 MB +35.47 KB +0.0%
hits_4.vortex 1.0 vortex-file-compressed 108.33 MB 108.37 MB +42.09 KB +0.0%
hits_45.vortex 1.0 vortex-file-compressed 121.93 MB 121.97 MB +46.47 KB +0.0%
hits_24.vortex 1.0 vortex-file-compressed 75.93 MB 75.96 MB +28.92 KB +0.0%
hits_26.vortex 1.0 vortex-file-compressed 109.18 MB 109.22 MB +40.34 KB +0.0%
hits_9.vortex 1.0 vortex-file-compressed 99.01 MB 99.05 MB +35.52 KB +0.0%
hits_61.vortex 1.0 vortex-file-compressed 100.98 MB 101.01 MB +34.99 KB +0.0%
hits_10.vortex 1.0 vortex-file-compressed 69.34 MB 69.36 MB +22.88 KB +0.0%
hits_11.vortex 1.0 vortex-file-compressed 79.71 MB 79.73 MB +24.23 KB +0.0%
hits_76.vortex 1.0 vortex-file-compressed 113.81 MB 113.84 MB +32.55 KB +0.0%
hits_65.vortex 1.0 vortex-file-compressed 183.47 MB 183.51 MB +43.76 KB +0.0%
hits_78.vortex 1.0 vortex-file-compressed 164.09 MB 164.12 MB +38.81 KB +0.0%
hits_92.vortex 1.0 vortex-file-compressed 146.46 MB 146.50 MB +34.12 KB +0.0%
hits_47.vortex 1.0 vortex-file-compressed 41.23 MB 41.24 MB +9.40 KB +0.0%
hits_1.vortex 1.0 vortex-file-compressed 138.17 MB 138.20 MB +30.59 KB +0.0%
hits_52.vortex 1.0 vortex-file-compressed 103.53 MB 103.55 MB +22.71 KB +0.0%
hits_5.vortex 1.0 vortex-file-compressed 92.89 MB 92.91 MB +18.69 KB +0.0%
hits_95.vortex 1.0 vortex-file-compressed 96.11 MB 96.13 MB +18.72 KB +0.0%
hits_80.vortex 1.0 vortex-file-compressed 104.96 MB 104.97 MB +17.20 KB +0.0%
hits_46.vortex 1.0 vortex-file-compressed 69.05 MB 69.06 MB +10.75 KB +0.0%
hits_99.vortex 1.0 vortex-file-compressed 122.83 MB 122.85 MB +18.29 KB +0.0%
hits_48.vortex 1.0 vortex-file-compressed 28.02 MB 28.02 MB +4.13 KB +0.0%
hits_55.vortex 1.0 vortex-file-compressed 168.89 MB 168.92 MB +24.16 KB +0.0%
hits_89.vortex 1.0 vortex-file-compressed 184.38 MB 184.41 MB +25.01 KB +0.0%
hits_71.vortex 1.0 vortex-file-compressed 101.59 MB 101.60 MB +13.59 KB +0.0%
hits_58.vortex 1.0 vortex-file-compressed 90.23 MB 90.24 MB +9.37 KB +0.0%
hits_13.vortex 1.0 vortex-file-compressed 99.05 MB 99.06 MB +8.71 KB +0.0%
hits_66.vortex 1.0 vortex-file-compressed 90.12 MB 90.12 MB +6.73 KB +0.0%
hits_88.vortex 1.0 vortex-file-compressed 110.86 MB 110.86 MB +6.12 KB +0.0%
hits_40.vortex 1.0 vortex-file-compressed 117.61 MB 117.62 MB +3.98 KB +0.0%
hits_6.vortex 1.0 vortex-file-compressed 93.28 MB 93.28 MB +544 B +0.0%
hits_56.vortex 1.0 vortex-file-compressed 123.19 MB 123.19 MB 488 B -0.0%
hits_54.vortex 1.0 vortex-compact 117.57 MB 117.57 MB 1.19 KB -0.0%
hits_51.vortex 1.0 vortex-file-compressed 277.55 MB 277.54 MB 15.20 KB -0.0%
hits_0.vortex 1.0 vortex-file-compressed 89.46 MB 89.46 MB 5.95 KB -0.0%
hits_22.vortex 1.0 vortex-file-compressed 76.83 MB 76.82 MB 6.59 KB -0.0%
hits_30.vortex 1.0 vortex-compact 58.57 MB 58.57 MB 9.02 KB -0.0%
hits_2.vortex 1.0 vortex-compact 129.16 MB 129.14 MB 21.93 KB -0.0%
hits_7.vortex 1.0 vortex-file-compressed 93.91 MB 93.90 MB 16.25 KB -0.0%
hits_54.vortex 1.0 vortex-file-compressed 221.20 MB 221.16 MB 42.55 KB -0.0%
hits_21.vortex 1.0 vortex-file-compressed 92.74 MB 92.72 MB 20.36 KB -0.0%
hits_94.vortex 1.0 vortex-file-compressed 138.43 MB 138.39 MB 31.37 KB -0.0%
hits_68.vortex 1.0 vortex-file-compressed 122.94 MB 122.92 MB 29.34 KB -0.0%
hits_16.vortex 1.0 vortex-file-compressed 79.36 MB 79.34 MB 21.09 KB -0.0%
hits_27.vortex 1.0 vortex-file-compressed 122.36 MB 122.33 MB 32.67 KB -0.0%
hits_87.vortex 1.0 vortex-compact 118.86 MB 118.83 MB 33.18 KB -0.0%
hits_93.vortex 1.0 vortex-file-compressed 90.22 MB 90.19 MB 30.07 KB -0.0%
hits_74.vortex 1.0 vortex-file-compressed 119.60 MB 119.56 MB 41.87 KB -0.0%
hits_86.vortex 1.0 vortex-file-compressed 69.12 MB 69.10 MB 25.46 KB -0.0%
hits_30.vortex 1.0 vortex-file-compressed 86.76 MB 86.73 MB 32.00 KB -0.0%
hits_78.vortex 1.0 vortex-compact 97.85 MB 97.81 MB 38.35 KB -0.0%
hits_28.vortex 1.0 vortex-file-compressed 119.70 MB 119.65 MB 48.46 KB -0.0%
hits_8.vortex 1.0 vortex-file-compressed 93.20 MB 93.16 MB 37.75 KB -0.0%
hits_82.vortex 1.0 vortex-file-compressed 99.52 MB 99.47 MB 53.16 KB -0.1%
hits_32.vortex 1.0 vortex-file-compressed 66.57 MB 66.54 MB 38.87 KB -0.1%
hits_98.vortex 1.0 vortex-file-compressed 118.16 MB 118.09 MB 71.17 KB -0.1%
hits_60.vortex 1.0 vortex-file-compressed 103.18 MB 103.12 MB 62.68 KB -0.1%
hits_84.vortex 1.0 vortex-file-compressed 116.88 MB 116.81 MB 74.04 KB -0.1%
hits_81.vortex 1.0 vortex-file-compressed 100.70 MB 100.64 MB 64.03 KB -0.1%
hits_39.vortex 1.0 vortex-file-compressed 80.08 MB 80.03 MB 51.34 KB -0.1%
hits_43.vortex 1.0 vortex-file-compressed 226.39 MB 226.25 MB 149.37 KB -0.1%
hits_91.vortex 1.0 vortex-file-compressed 96.89 MB 96.82 MB 68.84 KB -0.1%
hits_41.vortex 1.0 vortex-file-compressed 223.01 MB 222.86 MB 161.31 KB -0.1%
hits_77.vortex 1.0 vortex-file-compressed 168.13 MB 168.01 MB 122.51 KB -0.1%
hits_18.vortex 1.0 vortex-file-compressed 104.43 MB 104.36 MB 77.27 KB -0.1%
hits_69.vortex 1.0 vortex-file-compressed 123.01 MB 122.92 MB 92.82 KB -0.1%
hits_47.vortex 1.0 vortex-compact 18.22 MB 18.20 MB 14.83 KB -0.1%
hits_34.vortex 1.0 vortex-file-compressed 97.47 MB 97.38 MB 85.91 KB -0.1%
hits_64.vortex 1.0 vortex-file-compressed 81.03 MB 80.96 MB 74.53 KB -0.1%
hits_36.vortex 1.0 vortex-file-compressed 68.44 MB 68.34 MB 100.59 KB -0.1%
hits_33.vortex 1.0 vortex-compact 35.92 MB 35.86 MB 57.46 KB -0.2%
hits_57.vortex 1.0 vortex-file-compressed 128.13 MB 127.92 MB 210.45 KB -0.2%
hits_69.vortex 1.0 vortex-compact 80.98 MB 80.83 MB 152.27 KB -0.2%
hits_73.vortex 1.0 vortex-file-compressed 109.68 MB 109.45 MB 239.60 KB -0.2%
hits_34.vortex 1.0 vortex-compact 58.24 MB 58.10 MB 137.88 KB -0.2%
hits_17.vortex 1.0 vortex-file-compressed 87.33 MB 87.11 MB 225.45 KB -0.3%
hits_49.vortex 1.0 vortex-file-compressed 75.56 MB 75.35 MB 217.16 KB -0.3%
hits_66.vortex 1.0 vortex-compact 53.52 MB 53.37 MB 156.55 KB -0.3%
hits_31.vortex 1.0 vortex-file-compressed 90.24 MB 89.98 MB 266.02 KB -0.3%
hits_92.vortex 1.0 vortex-compact 94.40 MB 94.12 MB 289.61 KB -0.3%
hits_25.vortex 1.0 vortex-file-compressed 113.50 MB 113.14 MB 364.13 KB -0.3%
hits_41.vortex 1.0 vortex-compact 166.05 MB 165.53 MB 532.99 KB -0.3%
hits_53.vortex 1.0 vortex-file-compressed 85.84 MB 85.57 MB 278.71 KB -0.3%
hits_43.vortex 1.0 vortex-compact 169.21 MB 168.65 MB 567.53 KB -0.3%
hits_42.vortex 1.0 vortex-compact 164.53 MB 163.98 MB 562.43 KB -0.3%
hits_4.vortex 1.0 vortex-compact 71.94 MB 71.70 MB 253.02 KB -0.3%
hits_51.vortex 1.0 vortex-compact 168.34 MB 167.76 MB 593.12 KB -0.3%
hits_67.vortex 1.0 vortex-compact 114.44 MB 113.94 MB 513.77 KB -0.4%
hits_57.vortex 1.0 vortex-compact 83.73 MB 83.36 MB 384.18 KB -0.4%
hits_94.vortex 1.0 vortex-compact 90.90 MB 90.49 MB 418.93 KB -0.5%
hits_61.vortex 1.0 vortex-compact 57.73 MB 57.47 MB 270.79 KB -0.5%
hits_77.vortex 1.0 vortex-compact 118.50 MB 117.91 MB 603.96 KB -0.5%
hits_29.vortex 1.0 vortex-compact 36.68 MB 36.50 MB 189.52 KB -0.5%
hits_0.vortex 1.0 vortex-compact 58.88 MB 58.58 MB 313.56 KB -0.5%
hits_1.vortex 1.0 vortex-compact 90.67 MB 90.20 MB 487.95 KB -0.5%
hits_64.vortex 1.0 vortex-compact 54.09 MB 53.79 MB 305.09 KB -0.6%
hits_74.vortex 1.0 vortex-compact 71.87 MB 71.47 MB 412.72 KB -0.6%
hits_88.vortex 1.0 vortex-compact 73.58 MB 73.16 MB 436.53 KB -0.6%
hits_85.vortex 1.0 vortex-compact 52.86 MB 52.54 MB 329.34 KB -0.6%
hits_36.vortex 1.0 vortex-compact 49.21 MB 48.91 MB 309.54 KB -0.6%
hits_99.vortex 1.0 vortex-compact 77.65 MB 77.17 MB 491.83 KB -0.6%
hits_31.vortex 1.0 vortex-compact 55.77 MB 55.42 MB 355.80 KB -0.6%
hits_38.vortex 1.0 vortex-compact 63.39 MB 62.97 MB 437.22 KB -0.7%
hits_7.vortex 1.0 vortex-compact 64.19 MB 63.73 MB 470.58 KB -0.7%
hits_79.vortex 1.0 vortex-compact 86.17 MB 85.54 MB 642.80 KB -0.7%
hits_98.vortex 1.0 vortex-compact 73.15 MB 72.61 MB 549.95 KB -0.7%
hits_91.vortex 1.0 vortex-compact 61.24 MB 60.78 MB 469.90 KB -0.7%
hits_35.vortex 1.0 vortex-compact 75.53 MB 74.96 MB 582.34 KB -0.8%
hits_44.vortex 1.0 vortex-compact 133.26 MB 132.25 MB 1.00 MB -0.8%
hits_6.vortex 1.0 vortex-compact 63.57 MB 63.09 MB 493.49 KB -0.8%
hits_59.vortex 1.0 vortex-compact 66.68 MB 66.16 MB 528.62 KB -0.8%
hits_5.vortex 1.0 vortex-compact 63.33 MB 62.84 MB 502.39 KB -0.8%
hits_39.vortex 1.0 vortex-compact 50.10 MB 49.70 MB 403.78 KB -0.8%
hits_97.vortex 1.0 vortex-compact 69.58 MB 68.98 MB 610.52 KB -0.9%
hits_96.vortex 1.0 vortex-compact 91.73 MB 90.93 MB 825.38 KB -0.9%
hits_20.vortex 1.0 vortex-compact 38.36 MB 38.01 MB 353.12 KB -0.9%
hits_8.vortex 1.0 vortex-compact 63.39 MB 62.82 MB 584.95 KB -0.9%
hits_81.vortex 1.0 vortex-compact 65.95 MB 65.34 MB 627.15 KB -0.9%
hits_63.vortex 1.0 vortex-compact 46.44 MB 46.01 MB 442.01 KB -0.9%
hits_82.vortex 1.0 vortex-compact 67.43 MB 66.79 MB 657.87 KB -1.0%
hits_15.vortex 1.0 vortex-compact 48.41 MB 47.95 MB 476.70 KB -1.0%
hits_12.vortex 1.0 vortex-compact 69.86 MB 69.17 MB 702.44 KB -1.0%
hits_95.vortex 1.0 vortex-compact 58.20 MB 57.61 MB 604.66 KB -1.0%
hits_46.vortex 1.0 vortex-compact 42.27 MB 41.83 MB 448.34 KB -1.0%
hits_28.vortex 1.0 vortex-compact 70.92 MB 70.19 MB 753.89 KB -1.0%
hits_56.vortex 1.0 vortex-compact 78.58 MB 77.76 MB 841.80 KB -1.0%
hits_50.vortex 1.0 vortex-compact 114.20 MB 113.00 MB 1.20 MB -1.1%
hits_76.vortex 1.0 vortex-compact 77.10 MB 76.28 MB 839.78 KB -1.1%
hits_68.vortex 1.0 vortex-compact 76.67 MB 75.86 MB 836.50 KB -1.1%
hits_17.vortex 1.0 vortex-compact 58.79 MB 58.16 MB 644.05 KB -1.1%
hits_70.vortex 1.0 vortex-compact 61.84 MB 61.17 MB 684.99 KB -1.1%
hits_3.vortex 1.0 vortex-compact 95.12 MB 94.06 MB 1.06 MB -1.1%
hits_49.vortex 1.0 vortex-compact 51.00 MB 50.43 MB 583.42 KB -1.1%
hits_71.vortex 1.0 vortex-compact 69.96 MB 69.18 MB 804.52 KB -1.1%
hits_80.vortex 1.0 vortex-compact 68.67 MB 67.88 MB 802.68 KB -1.1%
hits_21.vortex 1.0 vortex-compact 51.99 MB 51.39 MB 613.90 KB -1.2%
hits_9.vortex 1.0 vortex-compact 66.32 MB 65.55 MB 784.46 KB -1.2%
hits_18.vortex 1.0 vortex-compact 64.89 MB 64.14 MB 769.74 KB -1.2%
hits_60.vortex 1.0 vortex-compact 64.92 MB 64.16 MB 778.86 KB -1.2%
hits_89.vortex 1.0 vortex-compact 114.10 MB 112.71 MB 1.39 MB -1.2%
hits_25.vortex 1.0 vortex-compact 73.88 MB 72.94 MB 964.99 KB -1.3%
hits_32.vortex 1.0 vortex-compact 44.61 MB 44.04 MB 583.17 KB -1.3%
hits_90.vortex 1.0 vortex-file-compressed 141.86 MB 139.81 MB 2.05 MB -1.4%
hits_10.vortex 1.0 vortex-compact 49.48 MB 48.76 MB 733.13 KB -1.4%
hits_58.vortex 1.0 vortex-compact 61.24 MB 60.32 MB 942.16 KB -1.5%
hits_14.vortex 1.0 vortex-compact 74.88 MB 73.61 MB 1.27 MB -1.7%
hits_73.vortex 1.0 vortex-compact 71.07 MB 69.84 MB 1.23 MB -1.7%
hits_26.vortex 1.0 vortex-compact 71.99 MB 70.74 MB 1.26 MB -1.7%
hits_62.vortex 1.0 vortex-compact 75.45 MB 74.09 MB 1.36 MB -1.8%
hits_84.vortex 1.0 vortex-compact 74.35 MB 72.95 MB 1.40 MB -1.9%
hits_53.vortex 1.0 vortex-compact 60.05 MB 58.89 MB 1.16 MB -1.9%
hits_37.vortex 1.0 vortex-compact 54.76 MB 53.69 MB 1.07 MB -1.9%
hits_86.vortex 1.0 vortex-compact 49.12 MB 48.16 MB 985.00 KB -2.0%
hits_93.vortex 1.0 vortex-compact 59.92 MB 58.74 MB 1.18 MB -2.0%
hits_13.vortex 1.0 vortex-compact 69.24 MB 67.87 MB 1.37 MB -2.0%
hits_72.vortex 1.0 vortex-compact 52.74 MB 51.61 MB 1.13 MB -2.1%
hits_40.vortex 1.0 vortex-compact 77.42 MB 75.75 MB 1.67 MB -2.2%
hits_83.vortex 1.0 vortex-compact 53.62 MB 52.40 MB 1.22 MB -2.3%
hits_52.vortex 1.0 vortex-compact 65.08 MB 63.55 MB 1.53 MB -2.4%
hits_16.vortex 1.0 vortex-compact 49.56 MB 48.08 MB 1.48 MB -3.0%
hits_48.vortex 1.0 vortex-compact 17.85 MB 17.28 MB 587.42 KB -3.2%
hits_11.vortex 1.0 vortex-compact 56.11 MB 54.23 MB 1.88 MB -3.3%
hits_75.vortex 1.0 vortex-compact 45.12 MB 43.57 MB 1.56 MB -3.5%
hits_22.vortex 1.0 vortex-compact 46.22 MB 44.50 MB 1.73 MB -3.7%
hits_24.vortex 1.0 vortex-compact 45.11 MB 43.39 MB 1.72 MB -3.8%
hits_23.vortex 1.0 vortex-compact 46.13 MB 43.93 MB 2.20 MB -4.8%
hits_19.vortex 1.0 vortex-compact 49.73 MB 44.74 MB 4.99 MB -10.0%
duckdb.db 1.0 vortex-compact 268.00 KB 0 B 268.00 KB -100.0%

Totals:

  • vortex-compact: 7.11 GB → 7.05 GB (-0.9%)
  • vortex-file-compressed: 10.98 GB → 10.98 GB (-0.0%)

@github-actions

github-actions Bot commented Jul 14, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -1.2%
Engines: DataFusion No clear signal (-6.5%, environment too noisy confidence) · DuckDB No clear signal (+4.3%, environment too noisy confidence)
Vortex (geomean): 0.898x ➖
Parquet (geomean): 0.909x ➖
Shifts: Parquet (control) -9.1% · Median polish -9.5%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (0.854x ➖, 5↑ 1↓)
name PR ff7d356 (ns) base 5abaf98 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 284097825 296409078 0.96
tpch_q02/datafusion:vortex-file-compressed 496034034 518254264 0.96
tpch_q03/datafusion:vortex-file-compressed 470337971 497918675 0.94
tpch_q04/datafusion:vortex-file-compressed 268295132 293963691 0.91
tpch_q05/datafusion:vortex-file-compressed 521021000 485423123 1.07
tpch_q06/datafusion:vortex-file-compressed 342607794 313270498 1.09
tpch_q07/datafusion:vortex-file-compressed 514518131 598965151 0.86
tpch_q08/datafusion:vortex-file-compressed 833876833 752706721 1.11
tpch_q09/datafusion:vortex-file-compressed 🚨 823678938 557570196 1.48
tpch_q10/datafusion:vortex-file-compressed 650443867 705872774 0.92
tpch_q11/datafusion:vortex-file-compressed 312577919 376828116 0.83
tpch_q12/datafusion:vortex-file-compressed 440840687 627561551 0.70
tpch_q13/datafusion:vortex-file-compressed 192426749 234397736 0.82
tpch_q14/datafusion:vortex-file-compressed 265539818 354273968 0.75
tpch_q15/datafusion:vortex-file-compressed 🚀 477761831 682663702 0.70
tpch_q16/datafusion:vortex-file-compressed 217800550 244881461 0.89
tpch_q17/datafusion:vortex-file-compressed 🚀 343026089 517952868 0.66
tpch_q18/datafusion:vortex-file-compressed 🚀 273336306 448562160 0.61
tpch_q19/datafusion:vortex-file-compressed 🚀 434198229 710563956 0.61
tpch_q20/datafusion:vortex-file-compressed 400433378 490999168 0.82
tpch_q21/datafusion:vortex-file-compressed 744252487 830813545 0.90
tpch_q22/datafusion:vortex-file-compressed 🚀 197250502 304398214 0.65
datafusion / vortex-compact (0.878x ➖, 1↑ 1↓)
name PR ff7d356 (ns) base 5abaf98 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 305534040 300755345 1.02
tpch_q02/datafusion:vortex-compact 561887496 564198938 1.00
tpch_q03/datafusion:vortex-compact 476798644 544465868 0.88
tpch_q04/datafusion:vortex-compact 219730018 251058207 0.88
tpch_q05/datafusion:vortex-compact 424177721 432976938 0.98
tpch_q06/datafusion:vortex-compact 328110048 382110740 0.86
tpch_q07/datafusion:vortex-compact 481667801 550138637 0.88
tpch_q08/datafusion:vortex-compact 692604770 859028403 0.81
tpch_q09/datafusion:vortex-compact 412298980 561287374 0.73
tpch_q10/datafusion:vortex-compact 472535697 584918399 0.81
tpch_q11/datafusion:vortex-compact 380828374 389967174 0.98
tpch_q12/datafusion:vortex-compact 391089370 498810654 0.78
tpch_q13/datafusion:vortex-compact 206237227 203458618 1.01
tpch_q14/datafusion:vortex-compact 284170544 330027301 0.86
tpch_q15/datafusion:vortex-compact 545263926 587667853 0.93
tpch_q16/datafusion:vortex-compact 🚨 284200250 208733864 1.36
tpch_q17/datafusion:vortex-compact 367978472 472973836 0.78
tpch_q18/datafusion:vortex-compact 264062562 326553303 0.81
tpch_q19/datafusion:vortex-compact 565167007 676726551 0.84
tpch_q20/datafusion:vortex-compact 460374461 519385076 0.89
tpch_q21/datafusion:vortex-compact 🚀 534528606 774706567 0.69
tpch_q22/datafusion:vortex-compact 190583095 247173993 0.77
datafusion / parquet (0.926x ➖, 0↑ 1↓)
name PR ff7d356 (ns) base 5abaf98 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 248845168 237366326 1.05
tpch_q02/datafusion:parquet 435950280 443723321 0.98
tpch_q03/datafusion:parquet 🚨 538654243 389360880 1.38
tpch_q04/datafusion:parquet 298065916 276309680 1.08
tpch_q05/datafusion:parquet 511509534 501258114 1.02
tpch_q06/datafusion:parquet 170926781 238158814 0.72
tpch_q07/datafusion:parquet 478058137 446830528 1.07
tpch_q08/datafusion:parquet 565606881 563322568 1.00
tpch_q09/datafusion:parquet 544066615 471481352 1.15
tpch_q10/datafusion:parquet 487125823 598864858 0.81
tpch_q11/datafusion:parquet 403968263 398454266 1.01
tpch_q12/datafusion:parquet 215769729 304836520 0.71
tpch_q13/datafusion:parquet 426827138 509347634 0.84
tpch_q14/datafusion:parquet 197759678 258810246 0.76
tpch_q15/datafusion:parquet 346387006 407693898 0.85
tpch_q16/datafusion:parquet 188013056 191528281 0.98
tpch_q17/datafusion:parquet 424879802 500810387 0.85
tpch_q18/datafusion:parquet 434662808 536313602 0.81
tpch_q19/datafusion:parquet 338722718 344505112 0.98
tpch_q20/datafusion:parquet 333738707 450100670 0.74
tpch_q21/datafusion:parquet 539150776 646399221 0.83
tpch_q22/datafusion:parquet 221753312 218299321 1.02
duckdb / vortex-file-compressed (0.906x ➖, 0↑ 0↓)
name PR ff7d356 (ns) base 5abaf98 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 316400057 383968468 0.82
tpch_q02/duckdb:vortex-file-compressed 990761814 1090933859 0.91
tpch_q03/duckdb:vortex-file-compressed 736690941 702318919 1.05
tpch_q04/duckdb:vortex-file-compressed 415333697 498303647 0.83
tpch_q05/duckdb:vortex-file-compressed 807363780 932440226 0.87
tpch_q06/duckdb:vortex-file-compressed 389064481 467829413 0.83
tpch_q07/duckdb:vortex-file-compressed 904462624 1001489474 0.90
tpch_q08/duckdb:vortex-file-compressed 1109513104 1392953991 0.80
tpch_q09/duckdb:vortex-file-compressed 1009249802 1116578764 0.90
tpch_q10/duckdb:vortex-file-compressed 767706915 969989515 0.79
tpch_q11/duckdb:vortex-file-compressed 525373591 571961523 0.92
tpch_q12/duckdb:vortex-file-compressed 619874674 679396991 0.91
tpch_q13/duckdb:vortex-file-compressed 410490214 424799927 0.97
tpch_q14/duckdb:vortex-file-compressed 436597367 428081365 1.02
tpch_q15/duckdb:vortex-file-compressed 329108199 293822496 1.12
tpch_q16/duckdb:vortex-file-compressed 360756781 399098322 0.90
tpch_q17/duckdb:vortex-file-compressed 708865306 854328089 0.83
tpch_q18/duckdb:vortex-file-compressed 609796809 723991114 0.84
tpch_q19/duckdb:vortex-file-compressed 488562491 504834334 0.97
tpch_q20/duckdb:vortex-file-compressed 915506010 910827230 1.01
tpch_q21/duckdb:vortex-file-compressed 1185734096 1248866616 0.95
tpch_q22/duckdb:vortex-file-compressed 303456802 345701916 0.88
duckdb / vortex-compact (0.957x ➖, 0↑ 0↓)
name PR ff7d356 (ns) base 5abaf98 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 306629408 322273142 0.95
tpch_q02/duckdb:vortex-compact 982009344 1100206187 0.89
tpch_q03/duckdb:vortex-compact 644321992 702874611 0.92
tpch_q04/duckdb:vortex-compact 483793701 508893007 0.95
tpch_q05/duckdb:vortex-compact 885380301 824977427 1.07
tpch_q06/duckdb:vortex-compact 475715666 395451241 1.20
tpch_q07/duckdb:vortex-compact 912892262 990370370 0.92
tpch_q08/duckdb:vortex-compact 1165997439 1174956946 0.99
tpch_q09/duckdb:vortex-compact 1080382992 1039884675 1.04
tpch_q10/duckdb:vortex-compact 745713065 835663903 0.89
tpch_q11/duckdb:vortex-compact 501679981 557878041 0.90
tpch_q12/duckdb:vortex-compact 738176057 812309103 0.91
tpch_q13/duckdb:vortex-compact 367995365 495989759 0.74
tpch_q14/duckdb:vortex-compact 449065314 500406619 0.90
tpch_q15/duckdb:vortex-compact 318309377 322338489 0.99
tpch_q16/duckdb:vortex-compact 358931785 367866978 0.98
tpch_q17/duckdb:vortex-compact 647479315 720455837 0.90
tpch_q18/duckdb:vortex-compact 574579272 653179060 0.88
tpch_q19/duckdb:vortex-compact 523040007 470327313 1.11
tpch_q20/duckdb:vortex-compact 798004002 772577099 1.03
tpch_q21/duckdb:vortex-compact 1182814180 1172338879 1.01
tpch_q22/duckdb:vortex-compact 288568395 296054117 0.97
duckdb / parquet (0.893x ➖, 0↑ 0↓)
name PR ff7d356 (ns) base 5abaf98 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 468636355 560419886 0.84
tpch_q02/duckdb:parquet 1164428149 1093255940 1.07
tpch_q03/duckdb:parquet 1084207340 1135581181 0.95
tpch_q04/duckdb:parquet 686708818 735666218 0.93
tpch_q05/duckdb:parquet 1234892950 1448629030 0.85
tpch_q06/duckdb:parquet 465149891 487195174 0.95
tpch_q07/duckdb:parquet 1164684259 1366645520 0.85
tpch_q08/duckdb:parquet 1524579239 1771511904 0.86
tpch_q09/duckdb:parquet 1355159653 1474866529 0.92
tpch_q10/duckdb:parquet 1287179829 1392504773 0.92
tpch_q11/duckdb:parquet 685231523 867518050 0.79
tpch_q12/duckdb:parquet 790145513 789076549 1.00
tpch_q13/duckdb:parquet 901666052 954577964 0.94
tpch_q14/duckdb:parquet 703447744 800386351 0.88
tpch_q15/duckdb:parquet 589638593 711026458 0.83
tpch_q16/duckdb:parquet 673390020 734728512 0.92
tpch_q17/duckdb:parquet 722270725 918947705 0.79
tpch_q18/duckdb:parquet 882881957 1052083332 0.84
tpch_q19/duckdb:parquet 762215864 907463503 0.84
tpch_q20/duckdb:parquet 1068781987 1280341470 0.83
tpch_q21/duckdb:parquet 1066201552 1189478463 0.90
tpch_q22/duckdb:parquet 605083047 610364488 0.99

@github-actions

github-actions Bot commented Jul 14, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Random Access

Vortex (geomean): 0.884x ✅
Parquet (geomean): 0.953x ➖

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
unknown / unknown (0.938x ➖, 11↑ 0↓)
name PR ff7d356 (ns) base 5abaf98 (ns) ratio (PR/base)
random-access/feature-vectors/correlated/lance-tokio-local-disk 363002 368504 0.99
random-access/feature-vectors/correlated/lance-tokio-local-disk-footer 1044962 1059778 0.99
random-access/feature-vectors/correlated/parquet-tokio-local-disk 8421468368 8661452060 0.97
random-access/feature-vectors/correlated/parquet-tokio-local-disk-footer 8365234977 8421913165 0.99
random-access/feature-vectors/correlated/vortex-tokio-local-disk 🚀 3017315 3447139 0.88
random-access/feature-vectors/correlated/vortex-tokio-local-disk-footer 2495621 2631229 0.95
random-access/feature-vectors/uniform/lance-tokio-local-disk 1144488 1162725 0.98
random-access/feature-vectors/uniform/lance-tokio-local-disk-footer 1820058 1913850 0.95
random-access/feature-vectors/uniform/parquet-tokio-local-disk 8190880422 8552602375 0.96
random-access/feature-vectors/uniform/parquet-tokio-local-disk-footer 8158769359 8682413046 0.94
random-access/feature-vectors/uniform/vortex-tokio-local-disk 3374344 3491159 0.97
random-access/feature-vectors/uniform/vortex-tokio-local-disk-footer 5566256 5862099 0.95
random-access/lance-tokio-local-disk 628349 638447 0.98
random-access/lance-tokio-local-disk-footer 1277855 1279921 1.00
random-access/nested-lists/correlated/lance-tokio-local-disk 222593 218030 1.02
random-access/nested-lists/correlated/lance-tokio-local-disk-footer 557754 558136 1.00
random-access/nested-lists/correlated/parquet-tokio-local-disk 128482790 130036617 0.99
random-access/nested-lists/correlated/parquet-tokio-local-disk-footer 125832247 134341405 0.94
random-access/nested-lists/correlated/vortex-tokio-local-disk 334906 336492 1.00
random-access/nested-lists/correlated/vortex-tokio-local-disk-footer 🚀 419902 474285 0.89
random-access/nested-lists/uniform/lance-tokio-local-disk 1005566 1021037 0.98
random-access/nested-lists/uniform/lance-tokio-local-disk-footer 1334625 1342915 0.99
random-access/nested-lists/uniform/parquet-tokio-local-disk 127191402 128641924 0.99
random-access/nested-lists/uniform/parquet-tokio-local-disk-footer 127197919 134185770 0.95
random-access/nested-lists/uniform/vortex-tokio-local-disk 1830173 1907909 0.96
random-access/nested-lists/uniform/vortex-tokio-local-disk-footer 1930976 2057331 0.94
random-access/nested-structs/correlated/lance-tokio-local-disk 341946 351351 0.97
random-access/nested-structs/correlated/lance-tokio-local-disk-footer 522329 535793 0.97
random-access/nested-structs/correlated/parquet-tokio-local-disk 🚀 20334240 23711025 0.86
random-access/nested-structs/correlated/parquet-tokio-local-disk-footer 20653241 21966697 0.94
random-access/nested-structs/correlated/vortex-tokio-local-disk 405363 419655 0.97
random-access/nested-structs/correlated/vortex-tokio-local-disk-footer 🚀 538654 612151 0.88
random-access/nested-structs/uniform/lance-tokio-local-disk 2384891 2570602 0.93
random-access/nested-structs/uniform/lance-tokio-local-disk-footer 2766167 2659624 1.04
random-access/nested-structs/uniform/parquet-tokio-local-disk 20428788 21684113 0.94
random-access/nested-structs/uniform/parquet-tokio-local-disk-footer 🚀 19802640 23209935 0.85
random-access/nested-structs/uniform/vortex-tokio-local-disk 🚀 1050523 1339333 0.78
random-access/nested-structs/uniform/vortex-tokio-local-disk-footer 🚀 1174763 1433884 0.82
random-access/parquet-tokio-local-disk 167658531 166997618 1.00
random-access/parquet-tokio-local-disk-footer 166255916 165166449 1.01
random-access/taxi/correlated/lance-tokio-local-disk 915802 974816 0.94
random-access/taxi/correlated/lance-tokio-local-disk-footer 1778881 1865897 0.95
random-access/taxi/correlated/parquet-tokio-local-disk 251829303 264487025 0.95
random-access/taxi/correlated/parquet-tokio-local-disk-footer 249701780 252114656 0.99
random-access/taxi/correlated/vortex-tokio-local-disk 🚀 1063927 1280863 0.83
random-access/taxi/correlated/vortex-tokio-local-disk-footer 1545265 1669352 0.93
random-access/taxi/uniform/lance-tokio-local-disk 9322844 9504221 0.98
random-access/taxi/uniform/lance-tokio-local-disk-footer 9919177 10454947 0.95
random-access/taxi/uniform/parquet-tokio-local-disk 262999498 282581467 0.93
random-access/taxi/uniform/parquet-tokio-local-disk-footer 264494908 270983136 0.98
random-access/taxi/uniform/vortex-tokio-local-disk 🚀 3572714 4607589 0.78
random-access/taxi/uniform/vortex-tokio-local-disk-footer 🚀 4054216 5828839 0.70
random-access/vortex-tokio-local-disk 🚀 683291 769312 0.89
random-access/vortex-tokio-local-disk-footer 1040670 1154622 0.90

@github-actions

github-actions Bot commented Jul 14, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Compression

Vortex (geomean): 0.989x ➖
Parquet (geomean): 1.003x ➖

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
unknown / unknown (1.004x ➖, 6↑ 6↓)
name PR ff7d356 (ns) base 5abaf98 (ns) ratio (PR/base)
compress time/Arade 1134916637 1098595175 1.03
compress time/Bimbo 5597250727 5630994409 0.99
compress time/CMSprovider 2766193919 2635183671 1.05
compress time/Euro2016 470595779 477044673 0.99
compress time/Food 🚀 342791013 383892446 0.89
compress time/HashTags 858468684 804686536 1.07
compress time/TPC-H l_comment canonical 1247725988 1190321247 1.05
compress time/TPC-H l_comment chunked 1213876303 1190419078 1.02
compress time/taxi 🚨 683798603 563985594 1.21
compress time/wide table cols=100 chunks=1 rows=1000 11879342 12477297 0.95
compress time/wide table cols=100 chunks=50 rows=1000 11712729 11705415 1.00
compress time/wide table cols=1000 chunks=1 rows=1000 140341658 133421134 1.05
compress time/wide table cols=1000 chunks=50 rows=1000 139109875 128525670 1.08
compress time/wide table cols=10000 chunks=1 rows=1000 1537671046 1501914726 1.02
compress time/wide table cols=10000 chunks=50 rows=1000 1528933791 1507969065 1.01
decompress time/Arade 26971516 27176522 0.99
decompress time/Bimbo 82086685 91100078 0.90
decompress time/CMSprovider 79036706 75494668 1.05
decompress time/Euro2016 19276914 20587411 0.94
decompress time/Food 8636367 8301829 1.04
decompress time/HashTags 97345886 93113866 1.05
decompress time/TPC-H l_comment canonical 42017858 41500534 1.01
decompress time/TPC-H l_comment chunked 43683587 41619913 1.05
decompress time/taxi 🚀 14821425 17086345 0.87
decompress time/wide table cols=100 chunks=1 rows=1000 2608335 2530127 1.03
decompress time/wide table cols=100 chunks=50 rows=1000 2611549 2507029 1.04
decompress time/wide table cols=1000 chunks=1 rows=1000 22060758 22038043 1.00
decompress time/wide table cols=1000 chunks=50 rows=1000 20560062 21991942 0.93
decompress time/wide table cols=10000 chunks=1 rows=1000 238437519 246890716 0.97
decompress time/wide table cols=10000 chunks=50 rows=1000 237312001 223672957 1.06
parquet size/Arade 258014282 258014282 1.00
parquet size/Bimbo 384517292 384517292 1.00
parquet size/CMSprovider 376885545 376885545 1.00
parquet size/Euro2016 122975499 122975499 1.00
parquet size/Food 35699500 35699500 1.00
parquet size/HashTags 133510943 133510943 1.00
parquet size/TPC-H l_comment canonical 158358238 158358238 1.00
parquet size/TPC-H l_comment chunked 158358238 158358238 1.00
parquet size/taxi 55283635 55283635 1.00
parquet size/wide table cols=100 chunks=1 rows=1000 932404 932404 1.00
parquet size/wide table cols=100 chunks=50 rows=1000 932404 932404 1.00
parquet size/wide table cols=1000 chunks=1 rows=1000 9324004 9324004 1.00
parquet size/wide table cols=1000 chunks=50 rows=1000 9324004 9324004 1.00
parquet size/wide table cols=10000 chunks=1 rows=1000 93240004 93240004 1.00
parquet size/wide table cols=10000 chunks=50 rows=1000 93240004 93240004 1.00
parquet_rs-zstd compress time/Arade 2701920932 2596801463 1.04
parquet_rs-zstd compress time/Bimbo 12581015132 12675661434 0.99
parquet_rs-zstd compress time/CMSprovider 6795592957 6787959687 1.00
parquet_rs-zstd compress time/Euro2016 1302648695 1300863965 1.00
parquet_rs-zstd compress time/Food 792127498 797370838 0.99
parquet_rs-zstd compress time/HashTags 2143763222 2142568374 1.00
parquet_rs-zstd compress time/TPC-H l_comment canonical 3208961136 3208021655 1.00
parquet_rs-zstd compress time/TPC-H l_comment chunked 3186857603 3201740895 1.00
parquet_rs-zstd compress time/taxi 1215815427 1179052191 1.03
parquet_rs-zstd compress time/wide table cols=100 chunks=1 rows=1000 🚨 6667075 6030020 1.11
parquet_rs-zstd compress time/wide table cols=100 chunks=50 rows=1000 🚨 7120735 6012099 1.18
parquet_rs-zstd compress time/wide table cols=1000 chunks=1 rows=1000 🚨 81472516 73712575 1.11
parquet_rs-zstd compress time/wide table cols=1000 chunks=50 rows=1000 77685809 73515912 1.06
parquet_rs-zstd compress time/wide table cols=10000 chunks=1 rows=1000 807280784 770520755 1.05
parquet_rs-zstd compress time/wide table cols=10000 chunks=50 rows=1000 845911456 778513652 1.09
parquet_rs-zstd decompress time/Arade 630311048 623358320 1.01
parquet_rs-zstd decompress time/Bimbo 1699340868 1703133014 1.00
parquet_rs-zstd decompress time/CMSprovider 1724673386 1700532516 1.01
parquet_rs-zstd decompress time/Euro2016 372968614 374159088 1.00
parquet_rs-zstd decompress time/Food 197300899 198840478 0.99
parquet_rs-zstd decompress time/HashTags 623156248 626091113 1.00
parquet_rs-zstd decompress time/TPC-H l_comment canonical 590340010 588677364 1.00
parquet_rs-zstd decompress time/TPC-H l_comment chunked 585675768 587830383 1.00
parquet_rs-zstd decompress time/taxi 248289550 245340629 1.01
parquet_rs-zstd decompress time/wide table cols=100 chunks=1 rows=1000 2927111 2784490 1.05
parquet_rs-zstd decompress time/wide table cols=100 chunks=50 rows=1000 2938320 2769635 1.06
parquet_rs-zstd decompress time/wide table cols=1000 chunks=1 rows=1000 🚨 34630672 31174090 1.11
parquet_rs-zstd decompress time/wide table cols=1000 chunks=50 rows=1000 33522549 32401767 1.03
parquet_rs-zstd decompress time/wide table cols=10000 chunks=1 rows=1000 355126511 343523579 1.03
parquet_rs-zstd decompress time/wide table cols=10000 chunks=50 rows=1000 355886480 346653702 1.03
vortex-file-compressed size/Arade 145359060 145358060 1.00
vortex-file-compressed size/Bimbo 467259636 467257556 1.00
vortex-file-compressed size/CMSprovider 417828828 417785732 1.00
vortex-file-compressed size/Euro2016 157407708 157816972 1.00
vortex-file-compressed size/Food 41977344 41976800 1.00
vortex-file-compressed size/HashTags 184572764 185286604 1.00
vortex-file-compressed size/TPC-H l_comment canonical 172162184 172117384 1.00
vortex-file-compressed size/TPC-H l_comment chunked 172084784 171915352 1.00
vortex-file-compressed size/taxi 52299180 52296276 1.00
vortex-file-compressed size/wide table cols=100 chunks=1 rows=1000 930912 932512 1.00
vortex-file-compressed size/wide table cols=100 chunks=50 rows=1000 930912 932512 1.00
vortex-file-compressed size/wide table cols=1000 chunks=1 rows=1000 9293712 9309712 1.00
vortex-file-compressed size/wide table cols=1000 chunks=50 rows=1000 9293712 9309712 1.00
vortex-file-compressed size/wide table cols=10000 chunks=1 rows=1000 92957712 93117712 1.00
vortex-file-compressed size/wide table cols=10000 chunks=50 rows=1000 92957712 93117712 1.00
vortex:parquet-zstd ratio compress time/Arade 0 0 0.99
vortex:parquet-zstd ratio compress time/Bimbo 0 0 1.00
vortex:parquet-zstd ratio compress time/CMSprovider 0 0 1.05
vortex:parquet-zstd ratio compress time/Euro2016 0 0 0.99
vortex:parquet-zstd ratio compress time/Food 🚀 0 0 0.90
vortex:parquet-zstd ratio compress time/HashTags 0 0 1.07
vortex:parquet-zstd ratio compress time/TPC-H l_comment canonical 0 0 1.05
vortex:parquet-zstd ratio compress time/TPC-H l_comment chunked 0 0 1.02
vortex:parquet-zstd ratio compress time/taxi 🚨 0 0 1.18
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=1 rows=1000 🚀 1 2 0.86
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=50 rows=1000 🚀 1 1 0.84
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=1 rows=1000 1 1 0.95
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=50 rows=1000 1 1 1.02
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=1 rows=1000 1 1 0.98
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=50 rows=1000 1 1 0.93
vortex:parquet-zstd ratio decompress time/Arade 0 0 0.98
vortex:parquet-zstd ratio decompress time/Bimbo 0 0 0.90
vortex:parquet-zstd ratio decompress time/CMSprovider 0 0 1.03
vortex:parquet-zstd ratio decompress time/Euro2016 0 0 0.94
vortex:parquet-zstd ratio decompress time/Food 0 0 1.05
vortex:parquet-zstd ratio decompress time/HashTags 0 0 1.05
vortex:parquet-zstd ratio decompress time/TPC-H l_comment canonical 0 0 1.01
vortex:parquet-zstd ratio decompress time/TPC-H l_comment chunked 0 0 1.05
vortex:parquet-zstd ratio decompress time/taxi 🚀 0 0 0.86
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=1 rows=1000 0 0 0.98
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=50 rows=1000 0 0 0.98
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=1 rows=1000 0 0 0.90
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=50 rows=1000 0 0 0.90
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=1 rows=1000 0 0 0.93
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=50 rows=1000 0 0 1.03
vortex:parquet-zstd size/Arade 0 0 1.00
vortex:parquet-zstd size/Bimbo 1 1 1.00
vortex:parquet-zstd size/CMSprovider 1 1 1.00
vortex:parquet-zstd size/Euro2016 1 1 1.00
vortex:parquet-zstd size/Food 1 1 1.00
vortex:parquet-zstd size/HashTags 1 1 1.00
vortex:parquet-zstd size/TPC-H l_comment canonical 1 1 1.00
vortex:parquet-zstd size/TPC-H l_comment chunked 1 1 1.00
vortex:parquet-zstd size/taxi 0 0 1.00
vortex:parquet-zstd size/wide table cols=100 chunks=1 rows=1000 0 1 1.00
vortex:parquet-zstd size/wide table cols=100 chunks=50 rows=1000 0 1 1.00
vortex:parquet-zstd size/wide table cols=1000 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=1000 chunks=50 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=10000 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=10000 chunks=50 rows=1000 0 0 1.00

@github-actions

github-actions Bot commented Jul 14, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Appian on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.8%
Engines: DataFusion No clear signal (+1.4%, low confidence) · DuckDB No clear signal (+0.8%, low confidence)
Vortex (geomean): 1.080x ➖
Parquet (geomean): 1.061x ➖
Shifts: Parquet (control) +6.1% · Median polish +7.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (1.083x ➖, 0↑ 2↓)
name PR ff7d356 (ns) base 5abaf98 (ns) ratio (PR/base)
appian_q01/datafusion:vortex-file-compressed 🚨 148507113 131229301 1.13
appian_q02/datafusion:vortex-file-compressed 648139629 602898219 1.08
appian_q03/datafusion:vortex-file-compressed 🚨 373418644 337776388 1.11
appian_q04/datafusion:vortex-file-compressed 47307168458 44891332615 1.05
appian_q05/datafusion:vortex-file-compressed 276396616 256021593 1.08
appian_q06/datafusion:vortex-file-compressed 368991281 337794630 1.09
appian_q07/datafusion:vortex-file-compressed 458814484 431207000 1.06
appian_q08/datafusion:vortex-file-compressed 2093671448 1962658767 1.07
datafusion / parquet (1.068x ➖, 0↑ 1↓)
name PR ff7d356 (ns) base 5abaf98 (ns) ratio (PR/base)
appian_q01/datafusion:parquet 137037313 134054969 1.02
appian_q02/datafusion:parquet 663928327 625362028 1.06
appian_q03/datafusion:parquet 🚨 378958042 340899610 1.11
appian_q04/datafusion:parquet 47481215752 44916976833 1.06
appian_q05/datafusion:parquet 304409139 285095465 1.07
appian_q06/datafusion:parquet 386972763 356855169 1.08
appian_q07/datafusion:parquet 481023245 446429157 1.08
appian_q08/datafusion:parquet 2073165106 1947993027 1.06
duckdb / vortex-file-compressed (1.076x ➖, 0↑ 3↓)
name PR ff7d356 (ns) base 5abaf98 (ns) ratio (PR/base)
appian_q01/duckdb:vortex-file-compressed 🚨 208907378 185613857 1.13
appian_q02/duckdb:vortex-file-compressed 655164390 602799159 1.09
appian_q03/duckdb:vortex-file-compressed 🚨 291983435 262368660 1.11
appian_q04/duckdb:vortex-file-compressed 1379886829 1342460167 1.03
appian_q05/duckdb:vortex-file-compressed 🚨 321368223 285858948 1.12
appian_q06/duckdb:vortex-file-compressed 825963594 804402818 1.03
appian_q07/duckdb:vortex-file-compressed 369771528 353068738 1.05
appian_q08/duckdb:vortex-file-compressed 1372177678 1289633214 1.06
duckdb / parquet (1.055x ➖, 0↑ 0↓)
name PR ff7d356 (ns) base 5abaf98 (ns) ratio (PR/base)
appian_q01/duckdb:parquet 222117763 206590322 1.08
appian_q02/duckdb:parquet 637163179 606090179 1.05
appian_q03/duckdb:parquet 311574625 290956007 1.07
appian_q04/duckdb:parquet 1369852191 1334786079 1.03
appian_q05/duckdb:parquet 334758760 305737058 1.09
appian_q06/duckdb:parquet 813281213 792985901 1.03
appian_q07/duckdb:parquet 380486926 365506590 1.04
appian_q08/duckdb:parquet 1343009868 1274302864 1.05
duckdb / duckdb (1.050x ➖, 0↑ 0↓)
name PR ff7d356 (ns) base 5abaf98 (ns) ratio (PR/base)
appian_q01/duckdb:duckdb 186844040 171626197 1.09
appian_q02/duckdb:duckdb 583532556 551031486 1.06
appian_q03/duckdb:duckdb 403053366 379637979 1.06
appian_q04/duckdb:duckdb 1350760877 1309869716 1.03
appian_q05/duckdb:duckdb 300834286 286609695 1.05
appian_q06/duckdb:duckdb 812095255 792037334 1.03
appian_q07/duckdb:duckdb 345250718 332215236 1.04
appian_q08/duckdb:duckdb 1290645298 1230981988 1.05
File Size Changes (19 files changed, -0.0% overall, 18↑ 1↓)
File Scale Format Base HEAD Change %
orderitemnovelty_update.vortex 1.0 vortex-compact 11.71 KB 13.17 KB +1.46 KB +12.4%
orderitemnovelty_update.vortex 1.0 vortex-file-compressed 11.71 KB 13.17 KB +1.46 KB +12.4%
categoryview.vortex 1.0 vortex-compact 18.29 KB 19.89 KB +1.60 KB +8.8%
productview.vortex 1.0 vortex-compact 17.38 KB 18.80 KB +1.43 KB +8.2%
categoryview.vortex 1.0 vortex-file-compressed 19.68 KB 20.77 KB +1.09 KB +5.6%
productview.vortex 1.0 vortex-file-compressed 19.55 KB 20.47 KB +944 B +4.7%
creditcardview.vortex 1.0 vortex-file-compressed 58.31 MB 58.38 MB +71.55 KB +0.1%
orderview.vortex 1.0 vortex-file-compressed 76.15 MB 76.23 MB +89.42 KB +0.1%
orderview.vortex 1.0 vortex-compact 31.02 MB 31.04 MB +20.40 KB +0.1%
taxrecordview.vortex 1.0 vortex-compact 17.33 MB 17.33 MB +1.84 KB +0.0%
taxrecordview.vortex 1.0 vortex-file-compressed 21.91 MB 21.91 MB +2.00 KB +0.0%
customerview.vortex 1.0 vortex-file-compressed 19.98 MB 19.98 MB +1.78 KB +0.0%
addressview.vortex 1.0 vortex-compact 24.52 MB 24.52 MB +1.72 KB +0.0%
customerview.vortex 1.0 vortex-compact 10.58 MB 10.58 MB +648 B +0.0%
addressview.vortex 1.0 vortex-file-compressed 34.61 MB 34.62 MB +1.86 KB +0.0%
creditcardview.vortex 1.0 vortex-compact 32.19 MB 32.19 MB +1.16 KB +0.0%
orderitemview.vortex 1.0 vortex-compact 155.98 MB 155.99 MB +1.84 KB +0.0%
orderitemview.vortex 1.0 vortex-file-compressed 265.21 MB 265.21 MB +1.90 KB +0.0%
duckdb.db 1.0 vortex-compact 268.00 KB 0 B 268.00 KB -100.0%

Totals:

  • vortex-compact: 271.93 MB → 271.69 MB (-0.1%)
  • vortex-file-compressed: 476.48 MB → 476.65 MB (+0.0%)

@github-actions

github-actions Bot commented Jul 14, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +1.8%
Engines: DataFusion No clear signal (+4.9%, environment too noisy confidence) · DuckDB No clear signal (-1.1%, environment too noisy confidence)
Vortex (geomean): 1.019x ➖
Parquet (geomean): 1.001x ➖
Shifts: Parquet (control) +0.1% · Median polish +0.8%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (1.005x ➖, 0↑ 1↓)
name PR ff7d356 (ns) base 2f18a4c (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 694947233 813203105 0.85
tpch_q02/datafusion:vortex-file-compressed 739870399 735079966 1.01
tpch_q03/datafusion:vortex-file-compressed 810535965 769586493 1.05
tpch_q04/datafusion:vortex-file-compressed 439710679 452065142 0.97
tpch_q05/datafusion:vortex-file-compressed 870333141 890363758 0.98
tpch_q06/datafusion:vortex-file-compressed 557501762 572869795 0.97
tpch_q07/datafusion:vortex-file-compressed 989690488 904930279 1.09
tpch_q08/datafusion:vortex-file-compressed 1249957384 1138779025 1.10
tpch_q09/datafusion:vortex-file-compressed 1214215557 1214440451 1.00
tpch_q10/datafusion:vortex-file-compressed 986096292 924605643 1.07
tpch_q11/datafusion:vortex-file-compressed 456799617 461053237 0.99
tpch_q12/datafusion:vortex-file-compressed 718047639 757625734 0.95
tpch_q13/datafusion:vortex-file-compressed 390336217 417299463 0.94
tpch_q14/datafusion:vortex-file-compressed 490261944 488767612 1.00
tpch_q15/datafusion:vortex-file-compressed 950989680 1186655670 0.80
tpch_q16/datafusion:vortex-file-compressed 413900802 452815109 0.91
tpch_q17/datafusion:vortex-file-compressed 1145615564 1393187326 0.82
tpch_q18/datafusion:vortex-file-compressed 1252342846 1157142364 1.08
tpch_q19/datafusion:vortex-file-compressed 911050764 867669271 1.05
tpch_q20/datafusion:vortex-file-compressed 918550745 847149369 1.08
tpch_q21/datafusion:vortex-file-compressed 1642289676 1364196186 1.20
tpch_q22/datafusion:vortex-file-compressed 🚨 504312408 381595074 1.32
datafusion / vortex-compact (1.064x ➖, 0↑ 1↓)
name PR ff7d356 (ns) base 2f18a4c (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 732764120 771016573 0.95
tpch_q02/datafusion:vortex-compact 881755419 806519409 1.09
tpch_q03/datafusion:vortex-compact 779010705 845644879 0.92
tpch_q04/datafusion:vortex-compact 431404536 441076522 0.98
tpch_q05/datafusion:vortex-compact 866610188 849767314 1.02
tpch_q06/datafusion:vortex-compact 575820847 522690481 1.10
tpch_q07/datafusion:vortex-compact 930719787 889163639 1.05
tpch_q08/datafusion:vortex-compact 1141262578 1147585187 0.99
tpch_q09/datafusion:vortex-compact 1259502918 1126594931 1.12
tpch_q10/datafusion:vortex-compact 🚨 1087366715 833839390 1.30
tpch_q11/datafusion:vortex-compact 459354934 413883278 1.11
tpch_q12/datafusion:vortex-compact 761109039 680940542 1.12
tpch_q13/datafusion:vortex-compact 455889056 440955115 1.03
tpch_q14/datafusion:vortex-compact 530297449 469228448 1.13
tpch_q15/datafusion:vortex-compact 955372985 862808810 1.11
tpch_q16/datafusion:vortex-compact 406302594 410467297 0.99
tpch_q17/datafusion:vortex-compact 1116145075 1109121304 1.01
tpch_q18/datafusion:vortex-compact 1089317487 1113147915 0.98
tpch_q19/datafusion:vortex-compact 1082547137 946181511 1.14
tpch_q20/datafusion:vortex-compact 929818735 909538992 1.02
tpch_q21/datafusion:vortex-compact 1436697947 1296153121 1.11
tpch_q22/datafusion:vortex-compact 569194723 473302867 1.20
datafusion / parquet (0.986x ➖, 1↑ 0↓)
name PR ff7d356 (ns) base 2f18a4c (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 884277327 870794450 1.02
tpch_q02/datafusion:parquet 943092510 964784711 0.98
tpch_q03/datafusion:parquet 884939336 1028449217 0.86
tpch_q04/datafusion:parquet 528377371 505344390 1.05
tpch_q05/datafusion:parquet 1144136924 1172146479 0.98
tpch_q06/datafusion:parquet 510987777 521818728 0.98
tpch_q07/datafusion:parquet 1459434094 1340319685 1.09
tpch_q08/datafusion:parquet 1655696517 1603640220 1.03
tpch_q09/datafusion:parquet 2054823773 1826251156 1.13
tpch_q10/datafusion:parquet 2408511554 2500593618 0.96
tpch_q11/datafusion:parquet 🚀 605461866 956624786 0.63
tpch_q12/datafusion:parquet 689023685 733494765 0.94
tpch_q13/datafusion:parquet 778212420 714922268 1.09
tpch_q14/datafusion:parquet 782821113 851070837 0.92
tpch_q15/datafusion:parquet 1405033123 1352650326 1.04
tpch_q16/datafusion:parquet 409536402 328184071 1.25
tpch_q17/datafusion:parquet 1558813816 1403562378 1.11
tpch_q18/datafusion:parquet 1528163274 2080248262 0.73
tpch_q19/datafusion:parquet 937741077 1091284577 0.86
tpch_q20/datafusion:parquet 1327480236 1302789157 1.02
tpch_q21/datafusion:parquet 1916573022 1745317018 1.10
tpch_q22/datafusion:parquet 865453511 746814924 1.16
duckdb / vortex-file-compressed (1.020x ➖, 0↑ 0↓)
name PR ff7d356 (ns) base 2f18a4c (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 629506389 619419183 1.02
tpch_q02/duckdb:vortex-file-compressed 1188334788 1280130748 0.93
tpch_q03/duckdb:vortex-file-compressed 933062719 899025019 1.04
tpch_q04/duckdb:vortex-file-compressed 672302512 672223409 1.00
tpch_q05/duckdb:vortex-file-compressed 1208186869 1125328506 1.07
tpch_q06/duckdb:vortex-file-compressed 566966799 625195531 0.91
tpch_q07/duckdb:vortex-file-compressed 1195088789 1169111802 1.02
tpch_q08/duckdb:vortex-file-compressed 1487458931 1480051396 1.01
tpch_q09/duckdb:vortex-file-compressed 1701233890 1674182439 1.02
tpch_q10/duckdb:vortex-file-compressed 1416197898 1262218594 1.12
tpch_q11/duckdb:vortex-file-compressed 668610094 707379790 0.95
tpch_q12/duckdb:vortex-file-compressed 1187792878 1236557577 0.96
tpch_q13/duckdb:vortex-file-compressed 760448752 783264636 0.97
tpch_q14/duckdb:vortex-file-compressed 689448777 660442882 1.04
tpch_q15/duckdb:vortex-file-compressed 579329277 529944142 1.09
tpch_q16/duckdb:vortex-file-compressed 540904988 548160439 0.99
tpch_q17/duckdb:vortex-file-compressed 936238513 912600225 1.03
tpch_q18/duckdb:vortex-file-compressed 960072165 891423039 1.08
tpch_q19/duckdb:vortex-file-compressed 819729945 764362038 1.07
tpch_q20/duckdb:vortex-file-compressed 1197497037 1237728342 0.97
tpch_q21/duckdb:vortex-file-compressed 1861728891 1785547524 1.04
tpch_q22/duckdb:vortex-file-compressed 455748131 394045470 1.16
duckdb / vortex-compact (0.989x ➖, 0↑ 0↓)
name PR ff7d356 (ns) base 2f18a4c (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 615683568 635344737 0.97
tpch_q02/duckdb:vortex-compact 1116276757 1145568683 0.97
tpch_q03/duckdb:vortex-compact 842412722 818680237 1.03
tpch_q04/duckdb:vortex-compact 578568722 582383271 0.99
tpch_q05/duckdb:vortex-compact 1089241448 1114253702 0.98
tpch_q06/duckdb:vortex-compact 554972971 550909027 1.01
tpch_q07/duckdb:vortex-compact 1103840469 1130803549 0.98
tpch_q08/duckdb:vortex-compact 1437256206 1526090676 0.94
tpch_q09/duckdb:vortex-compact 1572027857 1529835006 1.03
tpch_q10/duckdb:vortex-compact 1339486408 1348600987 0.99
tpch_q11/duckdb:vortex-compact 733909089 643975256 1.14
tpch_q12/duckdb:vortex-compact 1055581895 1163562459 0.91
tpch_q13/duckdb:vortex-compact 838983626 866480216 0.97
tpch_q14/duckdb:vortex-compact 616071151 633440354 0.97
tpch_q15/duckdb:vortex-compact 564605674 574105676 0.98
tpch_q16/duckdb:vortex-compact 437406154 427201322 1.02
tpch_q17/duckdb:vortex-compact 938869523 911818429 1.03
tpch_q18/duckdb:vortex-compact 915813463 835244202 1.10
tpch_q19/duckdb:vortex-compact 748043193 805014997 0.93
tpch_q20/duckdb:vortex-compact 1228344011 1244049845 0.99
tpch_q21/duckdb:vortex-compact 1712530317 1840514626 0.93
tpch_q22/duckdb:vortex-compact 442177218 474207364 0.93
duckdb / parquet (1.016x ➖, 0↑ 0↓)
name PR ff7d356 (ns) base 2f18a4c (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 826633353 861358611 0.96
tpch_q02/duckdb:parquet 1347112107 1259298035 1.07
tpch_q03/duckdb:parquet 1738986575 1722662055 1.01
tpch_q04/duckdb:parquet 979309840 991686990 0.99
tpch_q05/duckdb:parquet 2088266907 1737445789 1.20
tpch_q06/duckdb:parquet 837415121 740539104 1.13
tpch_q07/duckdb:parquet 1927612009 1794263812 1.07
tpch_q08/duckdb:parquet 2428462736 2429453895 1.00
tpch_q09/duckdb:parquet 2764034059 2519542403 1.10
tpch_q10/duckdb:parquet 3192671344 3128017476 1.02
tpch_q11/duckdb:parquet 990826244 986848319 1.00
tpch_q12/duckdb:parquet 1159450556 1341730564 0.86
tpch_q13/duckdb:parquet 1325997333 1289164291 1.03
tpch_q14/duckdb:parquet 1308593617 1352583482 0.97
tpch_q15/duckdb:parquet 904937925 949036781 0.95
tpch_q16/duckdb:parquet 951757612 954375954 1.00
tpch_q17/duckdb:parquet 1306315643 1360953584 0.96
tpch_q18/duckdb:parquet 1528158527 1474607789 1.04
tpch_q19/duckdb:parquet 1475517287 1505822941 0.98
tpch_q20/duckdb:parquet 1931542537 1822810825 1.06
tpch_q21/duckdb:parquet 1843932626 1728596327 1.07
tpch_q22/duckdb:parquet 1069336299 1150952891 0.93

@github-actions

github-actions Bot commented Jul 28, 2026

Copy link
Copy Markdown
Contributor

This PR has been marked as stale because it has been open for 14 days with no activity. Please comment or remove the stale label if you wish to keep it active, otherwise it will be closed in 7 days

@github-actions github-actions Bot added the stale This PR is stale and will be auto-closed soon label Jul 28, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@robert3005 robert3005 robert3005 left review comments
@joseph-isaacs joseph-isaacs Awaiting requested review from joseph-isaacs

At least 1 approving review is required to merge this pull request.

Assignees

No one assigned

Labels

changelog/performance A performance improvement stale This PR is stale and will be auto-closed soon

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

3 participants

@AdamGS @joseph-isaacs @robert3005